2023-07-14 08:12:14,423 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 08:12:14,703 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4 2023-07-14 08:12:14,704 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-14 08:12:14,752 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 08:12:15,083 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 08:12:15,084 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f, deleteOnExit=true 2023-07-14 08:12:15,085 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 08:12:15,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/test.cache.data in system properties and HBase conf 2023-07-14 08:12:15,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 08:12:15,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop.log.dir in system properties and HBase conf 2023-07-14 08:12:15,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 08:12:15,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 08:12:15,088 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 08:12:15,590 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 08:12:15,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:15,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:15,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 08:12:15,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:15,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 08:12:15,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 08:12:15,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:15,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:15,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 08:12:15,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/nfs.dump.dir in system properties and HBase conf 2023-07-14 08:12:15,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir in system properties and HBase conf 2023-07-14 08:12:15,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:15,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 08:12:15,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 08:12:16,304 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 08:12:16,311 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 08:12:16,696 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 08:12:17,002 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 08:12:17,023 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:17,088 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:17,140 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_localhost_44135_hdfs____686ef1/webapp 2023-07-14 08:12:17,301 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44135 2023-07-14 08:12:17,314 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 08:12:17,315 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 08:12:17,951 WARN [Listener at localhost/45081] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:18,145 WARN [Listener at localhost/45081] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 08:12:18,266 WARN [Listener at localhost/45081] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:18,279 INFO [Listener at localhost/45081] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:18,307 INFO [Listener at localhost/45081] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_localhost_38613_datanode____.l56s7a/webapp 2023-07-14 08:12:18,638 INFO [Listener at localhost/45081] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38613 2023-07-14 08:12:19,512 WARN [Listener at localhost/38697] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:19,579 WARN [Listener at localhost/38697] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 08:12:19,584 WARN [Listener at localhost/38697] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:19,587 INFO [Listener at localhost/38697] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:19,596 INFO [Listener at localhost/38697] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_localhost_42513_datanode____qyqdz4/webapp 2023-07-14 08:12:19,762 INFO [Listener at localhost/38697] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42513 2023-07-14 08:12:19,789 WARN [Listener at localhost/42689] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:19,851 WARN [Listener at localhost/42689] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 08:12:19,865 WARN [Listener at localhost/42689] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:19,868 INFO [Listener at localhost/42689] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:19,877 INFO [Listener at localhost/42689] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_localhost_45777_datanode____.i2qvab/webapp 2023-07-14 08:12:20,050 INFO [Listener at localhost/42689] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45777 2023-07-14 08:12:20,086 WARN [Listener at localhost/36375] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:20,342 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xebd10cf0ce44b411: Processing first storage report for DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c from datanode d805f4a2-21a8-4634-8de6-f32003f46355 2023-07-14 08:12:20,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xebd10cf0ce44b411: from storage DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c node DatanodeRegistration(127.0.0.1:43493, datanodeUuid=d805f4a2-21a8-4634-8de6-f32003f46355, infoPort=38139, infoSecurePort=0, ipcPort=38697, storageInfo=lv=-57;cid=testClusterID;nsid=663889000;c=1689322336404), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,344 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfaf14a88b304d6d6: Processing first storage report for DS-5667e5c7-4a91-489b-9983-e58ffea038e6 from datanode 2cc9ee7d-057c-43a2-a296-580ad21cef4c 2023-07-14 08:12:20,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfaf14a88b304d6d6: from storage DS-5667e5c7-4a91-489b-9983-e58ffea038e6 node DatanodeRegistration(127.0.0.1:38397, datanodeUuid=2cc9ee7d-057c-43a2-a296-580ad21cef4c, infoPort=33811, infoSecurePort=0, ipcPort=36375, storageInfo=lv=-57;cid=testClusterID;nsid=663889000;c=1689322336404), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x430c7405317f558e: Processing first storage report for DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb from datanode 49050c42-79cc-44a7-a859-3195456f1d31 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x430c7405317f558e: from storage DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb node DatanodeRegistration(127.0.0.1:33111, datanodeUuid=49050c42-79cc-44a7-a859-3195456f1d31, infoPort=35533, infoSecurePort=0, ipcPort=42689, storageInfo=lv=-57;cid=testClusterID;nsid=663889000;c=1689322336404), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xebd10cf0ce44b411: Processing first storage report for DS-b19bd5c9-218d-4107-8180-746205d36668 from datanode d805f4a2-21a8-4634-8de6-f32003f46355 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xebd10cf0ce44b411: from storage DS-b19bd5c9-218d-4107-8180-746205d36668 node DatanodeRegistration(127.0.0.1:43493, datanodeUuid=d805f4a2-21a8-4634-8de6-f32003f46355, infoPort=38139, infoSecurePort=0, ipcPort=38697, storageInfo=lv=-57;cid=testClusterID;nsid=663889000;c=1689322336404), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfaf14a88b304d6d6: Processing first storage report for DS-0a308f97-2213-47ca-b7e6-8f6861e358e9 from datanode 2cc9ee7d-057c-43a2-a296-580ad21cef4c 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfaf14a88b304d6d6: from storage DS-0a308f97-2213-47ca-b7e6-8f6861e358e9 node DatanodeRegistration(127.0.0.1:38397, datanodeUuid=2cc9ee7d-057c-43a2-a296-580ad21cef4c, infoPort=33811, infoSecurePort=0, ipcPort=36375, storageInfo=lv=-57;cid=testClusterID;nsid=663889000;c=1689322336404), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x430c7405317f558e: Processing first storage report for DS-78ea4051-1b9f-43c2-9ed1-7b674c4b3f04 from datanode 49050c42-79cc-44a7-a859-3195456f1d31 2023-07-14 08:12:20,345 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x430c7405317f558e: from storage DS-78ea4051-1b9f-43c2-9ed1-7b674c4b3f04 node DatanodeRegistration(127.0.0.1:33111, datanodeUuid=49050c42-79cc-44a7-a859-3195456f1d31, infoPort=35533, infoSecurePort=0, ipcPort=42689, storageInfo=lv=-57;cid=testClusterID;nsid=663889000;c=1689322336404), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,669 DEBUG [Listener at localhost/36375] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4 2023-07-14 08:12:20,779 INFO [Listener at localhost/36375] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/zookeeper_0, clientPort=54201, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 08:12:20,804 INFO [Listener at localhost/36375] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54201 2023-07-14 08:12:20,813 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:20,816 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:21,551 INFO [Listener at localhost/36375] util.FSUtils(471): Created version file at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c with version=8 2023-07-14 08:12:21,551 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/hbase-staging 2023-07-14 08:12:21,963 INFO [Listener at localhost/36375] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 08:12:22,582 INFO [Listener at localhost/36375] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:22,632 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:22,632 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:22,633 INFO [Listener at localhost/36375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:22,633 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:22,633 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:22,873 INFO [Listener at localhost/36375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:22,974 DEBUG [Listener at localhost/36375] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 08:12:23,108 INFO [Listener at localhost/36375] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45715 2023-07-14 08:12:23,128 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,130 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,164 INFO [Listener at localhost/36375] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45715 connecting to ZooKeeper ensemble=127.0.0.1:54201 2023-07-14 08:12:23,252 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:457150x0, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45715-0x10162d605320000 connected 2023-07-14 08:12:23,340 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,341 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,356 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,368 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45715 2023-07-14 08:12:23,369 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45715 2023-07-14 08:12:23,390 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45715 2023-07-14 08:12:23,395 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45715 2023-07-14 08:12:23,397 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45715 2023-07-14 08:12:23,408 INFO [Listener at localhost/36375] master.HMaster(444): hbase.rootdir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, hbase.cluster.distributed=false 2023-07-14 08:12:23,498 INFO [Listener at localhost/36375] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:23,498 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,498 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,499 INFO [Listener at localhost/36375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:23,499 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,499 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:23,504 INFO [Listener at localhost/36375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:23,511 INFO [Listener at localhost/36375] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44465 2023-07-14 08:12:23,515 INFO [Listener at localhost/36375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 08:12:23,525 DEBUG [Listener at localhost/36375] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 08:12:23,527 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,529 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,533 INFO [Listener at localhost/36375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44465 connecting to ZooKeeper ensemble=127.0.0.1:54201 2023-07-14 08:12:23,543 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:444650x0, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44465-0x10162d605320001 connected 2023-07-14 08:12:23,546 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,548 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,548 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,549 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44465 2023-07-14 08:12:23,553 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44465 2023-07-14 08:12:23,554 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44465 2023-07-14 08:12:23,555 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44465 2023-07-14 08:12:23,556 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44465 2023-07-14 08:12:23,570 INFO [Listener at localhost/36375] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:23,570 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,571 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,571 INFO [Listener at localhost/36375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:23,571 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,571 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:23,571 INFO [Listener at localhost/36375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:23,579 INFO [Listener at localhost/36375] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39739 2023-07-14 08:12:23,580 INFO [Listener at localhost/36375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 08:12:23,581 DEBUG [Listener at localhost/36375] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 08:12:23,582 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,585 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,587 INFO [Listener at localhost/36375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39739 connecting to ZooKeeper ensemble=127.0.0.1:54201 2023-07-14 08:12:23,592 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:397390x0, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,593 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:397390x0, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,596 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:397390x0, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,598 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:397390x0, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39739-0x10162d605320002 connected 2023-07-14 08:12:23,601 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39739 2023-07-14 08:12:23,605 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39739 2023-07-14 08:12:23,612 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39739 2023-07-14 08:12:23,613 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39739 2023-07-14 08:12:23,615 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39739 2023-07-14 08:12:23,629 INFO [Listener at localhost/36375] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:23,629 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,629 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,629 INFO [Listener at localhost/36375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:23,629 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,629 INFO [Listener at localhost/36375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:23,630 INFO [Listener at localhost/36375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:23,631 INFO [Listener at localhost/36375] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43891 2023-07-14 08:12:23,632 INFO [Listener at localhost/36375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 08:12:23,633 DEBUG [Listener at localhost/36375] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 08:12:23,634 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,637 INFO [Listener at localhost/36375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,639 INFO [Listener at localhost/36375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43891 connecting to ZooKeeper ensemble=127.0.0.1:54201 2023-07-14 08:12:23,648 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:438910x0, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43891-0x10162d605320003 connected 2023-07-14 08:12:23,650 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,651 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,652 DEBUG [Listener at localhost/36375] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,653 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43891 2023-07-14 08:12:23,653 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43891 2023-07-14 08:12:23,661 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43891 2023-07-14 08:12:23,663 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43891 2023-07-14 08:12:23,664 DEBUG [Listener at localhost/36375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43891 2023-07-14 08:12:23,666 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:23,679 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 08:12:23,681 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:23,706 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,706 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,706 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,708 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,708 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:23,709 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 08:12:23,711 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,45715,1689322341751 from backup master directory 2023-07-14 08:12:23,717 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:23,717 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 08:12:23,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 08:12:23,718 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:23,719 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:23,723 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 08:12:23,726 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 08:12:23,865 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/hbase.id with ID: bb2d1f70-3bfb-4647-a815-6aa48867640f 2023-07-14 08:12:23,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,942 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,014 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x16564da0 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:24,059 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c7a609d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:24,086 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:24,088 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 08:12:24,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 08:12:24,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 08:12:24,112 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 08:12:24,118 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 08:12:24,120 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:24,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store-tmp 2023-07-14 08:12:24,227 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:24,227 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 08:12:24,227 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,227 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,227 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 08:12:24,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,228 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 08:12:24,230 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/WALs/jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:24,258 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45715%2C1689322341751, suffix=, logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/WALs/jenkins-hbase9.apache.org,45715,1689322341751, archiveDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/oldWALs, maxLogs=10 2023-07-14 08:12:24,328 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK] 2023-07-14 08:12:24,329 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK] 2023-07-14 08:12:24,335 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK] 2023-07-14 08:12:24,345 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 08:12:24,425 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/WALs/jenkins-hbase9.apache.org,45715,1689322341751/jenkins-hbase9.apache.org%2C45715%2C1689322341751.1689322344270 2023-07-14 08:12:24,426 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK], DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK], DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK]] 2023-07-14 08:12:24,427 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:24,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:24,432 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,519 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,529 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 08:12:24,571 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 08:12:24,588 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:24,596 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,598 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,620 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,627 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:24,628 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63424944, jitterRate=-0.05489468574523926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:24,628 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 08:12:24,634 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 08:12:24,660 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 08:12:24,661 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 08:12:24,665 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 08:12:24,668 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 08:12:24,715 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 46 msec 2023-07-14 08:12:24,715 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 08:12:24,806 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 08:12:24,815 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 08:12:24,852 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 08:12:24,860 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 08:12:24,862 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 08:12:24,870 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 08:12:24,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 08:12:24,884 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,887 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 08:12:24,888 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 08:12:24,917 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 08:12:24,922 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,922 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,923 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,923 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,923 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,45715,1689322341751, sessionid=0x10162d605320000, setting cluster-up flag (Was=false) 2023-07-14 08:12:24,948 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 08:12:24,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:24,971 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,979 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 08:12:24,981 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:24,985 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp 2023-07-14 08:12:25,080 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(951): ClusterId : bb2d1f70-3bfb-4647-a815-6aa48867640f 2023-07-14 08:12:25,081 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(951): ClusterId : bb2d1f70-3bfb-4647-a815-6aa48867640f 2023-07-14 08:12:25,106 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(951): ClusterId : bb2d1f70-3bfb-4647-a815-6aa48867640f 2023-07-14 08:12:25,111 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 08:12:25,111 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 08:12:25,114 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 08:12:25,121 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 08:12:25,121 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 08:12:25,121 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 08:12:25,121 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 08:12:25,121 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 08:12:25,122 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 08:12:25,133 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 08:12:25,133 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 08:12:25,134 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 08:12:25,136 DEBUG [RS:1;jenkins-hbase9:39739] zookeeper.ReadOnlyZKClient(139): Connect 0x748530fb to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:25,137 DEBUG [RS:2;jenkins-hbase9:43891] zookeeper.ReadOnlyZKClient(139): Connect 0x12ce379a to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:25,156 DEBUG [RS:0;jenkins-hbase9:44465] zookeeper.ReadOnlyZKClient(139): Connect 0x217a9942 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:25,184 DEBUG [RS:1;jenkins-hbase9:39739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a42c01b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:25,185 DEBUG [RS:1;jenkins-hbase9:39739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e7d5b8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:12:25,186 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 08:12:25,227 DEBUG [RS:2;jenkins-hbase9:43891] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c09dbb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:25,228 DEBUG [RS:2;jenkins-hbase9:43891] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18365cea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:12:25,230 DEBUG [RS:0;jenkins-hbase9:44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fbd731d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:25,231 DEBUG [RS:0;jenkins-hbase9:44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b82f232, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:12:25,236 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:25,237 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 08:12:25,261 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:44465 2023-07-14 08:12:25,268 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:43891 2023-07-14 08:12:25,276 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:39739 2023-07-14 08:12:25,279 INFO [RS:0;jenkins-hbase9:44465] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 08:12:25,279 INFO [RS:0;jenkins-hbase9:44465] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 08:12:25,280 INFO [RS:1;jenkins-hbase9:39739] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 08:12:25,279 INFO [RS:2;jenkins-hbase9:43891] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 08:12:25,280 INFO [RS:2;jenkins-hbase9:43891] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 08:12:25,281 INFO [RS:1;jenkins-hbase9:39739] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 08:12:25,282 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 08:12:25,282 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 08:12:25,282 INFO [RS:2;jenkins-hbase9:43891] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:25,283 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 08:12:25,285 INFO [RS:0;jenkins-hbase9:44465] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:25,285 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 08:12:25,288 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,45715,1689322341751 with isa=jenkins-hbase9.apache.org/172.31.2.10:43891, startcode=1689322343628 2023-07-14 08:12:25,288 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,45715,1689322341751 with isa=jenkins-hbase9.apache.org/172.31.2.10:44465, startcode=1689322343497 2023-07-14 08:12:25,289 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 08:12:25,290 INFO [RS:1;jenkins-hbase9:39739] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:25,290 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 08:12:25,291 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,45715,1689322341751 with isa=jenkins-hbase9.apache.org/172.31.2.10:39739, startcode=1689322343570 2023-07-14 08:12:25,321 DEBUG [RS:0;jenkins-hbase9:44465] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 08:12:25,324 DEBUG [RS:1;jenkins-hbase9:39739] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 08:12:25,333 DEBUG [RS:2;jenkins-hbase9:43891] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 08:12:25,396 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 08:12:25,427 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,429 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55425, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 08:12:25,429 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36487, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 08:12:25,429 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36371, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 08:12:25,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689322375486 2023-07-14 08:12:25,491 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 08:12:25,494 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45715] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,500 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 08:12:25,500 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 08:12:25,509 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:25,521 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 08:12:25,525 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45715] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,533 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45715] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,541 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 08:12:25,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 08:12:25,547 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 08:12:25,547 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 08:12:25,562 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 08:12:25,573 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 08:12:25,573 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 08:12:25,584 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 08:12:25,585 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 08:12:25,587 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,587 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,587 WARN [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 08:12:25,587 WARN [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 08:12:25,590 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,590 WARN [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 08:12:25,595 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689322345588,5,FailOnTimeoutGroup] 2023-07-14 08:12:25,595 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689322345595,5,FailOnTimeoutGroup] 2023-07-14 08:12:25,596 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,597 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 08:12:25,600 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,600 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,640 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:25,642 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:25,642 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:25,689 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,45715,1689322341751 with isa=jenkins-hbase9.apache.org/172.31.2.10:43891, startcode=1689322343628 2023-07-14 08:12:25,689 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,45715,1689322341751 with isa=jenkins-hbase9.apache.org/172.31.2.10:39739, startcode=1689322343570 2023-07-14 08:12:25,691 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,45715,1689322341751 with isa=jenkins-hbase9.apache.org/172.31.2.10:44465, startcode=1689322343497 2023-07-14 08:12:25,704 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45715] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:25,725 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45715] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,730 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:25,730 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45081 2023-07-14 08:12:25,730 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 08:12:25,732 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45715] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:25,736 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:25,739 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:25,739 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45081 2023-07-14 08:12:25,739 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 08:12:25,741 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:12:25,747 DEBUG [RS:1;jenkins-hbase9:39739] zookeeper.ZKUtil(162): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,747 DEBUG [RS:2;jenkins-hbase9:43891] zookeeper.ZKUtil(162): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:25,750 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:25,750 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45081 2023-07-14 08:12:25,750 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 08:12:25,747 WARN [RS:1;jenkins-hbase9:39739] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:25,747 WARN [RS:2;jenkins-hbase9:43891] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:25,755 DEBUG [RS:0;jenkins-hbase9:44465] zookeeper.ZKUtil(162): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:25,755 WARN [RS:0;jenkins-hbase9:44465] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:25,751 INFO [RS:1;jenkins-hbase9:39739] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:25,756 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,755 INFO [RS:0;jenkins-hbase9:44465] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:25,757 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44465,1689322343497] 2023-07-14 08:12:25,759 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:25,756 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 08:12:25,751 INFO [RS:2;jenkins-hbase9:43891] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:25,759 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43891,1689322343628] 2023-07-14 08:12:25,760 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39739,1689322343570] 2023-07-14 08:12:25,760 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:25,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/info 2023-07-14 08:12:25,775 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 08:12:25,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:25,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 08:12:25,782 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/rep_barrier 2023-07-14 08:12:25,783 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 08:12:25,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:25,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 08:12:25,784 DEBUG [RS:2;jenkins-hbase9:43891] zookeeper.ZKUtil(162): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:25,785 DEBUG [RS:2;jenkins-hbase9:43891] zookeeper.ZKUtil(162): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:25,786 DEBUG [RS:0;jenkins-hbase9:44465] zookeeper.ZKUtil(162): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:25,786 DEBUG [RS:1;jenkins-hbase9:39739] zookeeper.ZKUtil(162): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:25,786 DEBUG [RS:2;jenkins-hbase9:43891] zookeeper.ZKUtil(162): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,787 DEBUG [RS:1;jenkins-hbase9:39739] zookeeper.ZKUtil(162): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:25,788 DEBUG [RS:1;jenkins-hbase9:39739] zookeeper.ZKUtil(162): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,788 DEBUG [RS:0;jenkins-hbase9:44465] zookeeper.ZKUtil(162): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:25,788 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/table 2023-07-14 08:12:25,789 DEBUG [RS:0;jenkins-hbase9:44465] zookeeper.ZKUtil(162): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,789 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 08:12:25,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:25,794 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740 2023-07-14 08:12:25,795 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740 2023-07-14 08:12:25,803 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 08:12:25,803 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 08:12:25,803 DEBUG [RS:2;jenkins-hbase9:43891] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 08:12:25,805 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 08:12:25,808 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 08:12:25,814 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:25,815 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69395195, jitterRate=0.034068986773490906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 08:12:25,815 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 08:12:25,815 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 08:12:25,815 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 08:12:25,815 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 08:12:25,815 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 08:12:25,815 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 08:12:25,818 INFO [RS:1;jenkins-hbase9:39739] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 08:12:25,818 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 08:12:25,818 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 08:12:25,818 INFO [RS:2;jenkins-hbase9:43891] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 08:12:25,818 INFO [RS:0;jenkins-hbase9:44465] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 08:12:25,831 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 08:12:25,831 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 08:12:25,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 08:12:25,856 INFO [RS:0;jenkins-hbase9:44465] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 08:12:25,857 INFO [RS:2;jenkins-hbase9:43891] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 08:12:25,878 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 08:12:25,890 INFO [RS:1;jenkins-hbase9:39739] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 08:12:25,891 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 08:12:25,900 INFO [RS:0;jenkins-hbase9:44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 08:12:25,900 INFO [RS:2;jenkins-hbase9:43891] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 08:12:25,901 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,901 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,901 INFO [RS:1;jenkins-hbase9:39739] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 08:12:25,902 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,903 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 08:12:25,908 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 08:12:25,910 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 08:12:25,921 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,921 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,922 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,921 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,922 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,922 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,923 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,924 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,924 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,924 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:1;jenkins-hbase9:39739] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:2;jenkins-hbase9:43891] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,925 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,925 DEBUG [RS:0;jenkins-hbase9:44465] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,929 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,929 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,929 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,931 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,931 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,931 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,944 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,944 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,944 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,956 INFO [RS:1;jenkins-hbase9:39739] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 08:12:25,956 INFO [RS:0;jenkins-hbase9:44465] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 08:12:25,961 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39739,1689322343570-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,963 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44465,1689322343497-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,971 INFO [RS:2;jenkins-hbase9:43891] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 08:12:25,971 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43891,1689322343628-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,990 INFO [RS:1;jenkins-hbase9:39739] regionserver.Replication(203): jenkins-hbase9.apache.org,39739,1689322343570 started 2023-07-14 08:12:25,990 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,39739,1689322343570, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39739, sessionid=0x10162d605320002 2023-07-14 08:12:25,991 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 08:12:25,991 DEBUG [RS:1;jenkins-hbase9:39739] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,991 DEBUG [RS:1;jenkins-hbase9:39739] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39739,1689322343570' 2023-07-14 08:12:25,991 DEBUG [RS:1;jenkins-hbase9:39739] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 08:12:25,992 DEBUG [RS:1;jenkins-hbase9:39739] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 08:12:25,993 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 08:12:25,993 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 08:12:25,993 DEBUG [RS:1;jenkins-hbase9:39739] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:25,993 DEBUG [RS:1;jenkins-hbase9:39739] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39739,1689322343570' 2023-07-14 08:12:25,993 DEBUG [RS:1;jenkins-hbase9:39739] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:25,994 DEBUG [RS:1;jenkins-hbase9:39739] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:25,994 DEBUG [RS:1;jenkins-hbase9:39739] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 08:12:25,995 INFO [RS:1;jenkins-hbase9:39739] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 08:12:25,995 INFO [RS:1;jenkins-hbase9:39739] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 08:12:26,004 INFO [RS:0;jenkins-hbase9:44465] regionserver.Replication(203): jenkins-hbase9.apache.org,44465,1689322343497 started 2023-07-14 08:12:26,004 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,44465,1689322343497, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44465, sessionid=0x10162d605320001 2023-07-14 08:12:26,005 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 08:12:26,005 DEBUG [RS:0;jenkins-hbase9:44465] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:26,008 DEBUG [RS:0;jenkins-hbase9:44465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44465,1689322343497' 2023-07-14 08:12:26,009 DEBUG [RS:0;jenkins-hbase9:44465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 08:12:26,010 DEBUG [RS:0;jenkins-hbase9:44465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 08:12:26,011 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 08:12:26,011 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 08:12:26,013 INFO [RS:2;jenkins-hbase9:43891] regionserver.Replication(203): jenkins-hbase9.apache.org,43891,1689322343628 started 2023-07-14 08:12:26,013 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,43891,1689322343628, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43891, sessionid=0x10162d605320003 2023-07-14 08:12:26,013 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 08:12:26,013 DEBUG [RS:2;jenkins-hbase9:43891] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:26,013 DEBUG [RS:2;jenkins-hbase9:43891] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43891,1689322343628' 2023-07-14 08:12:26,013 DEBUG [RS:2;jenkins-hbase9:43891] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 08:12:26,011 DEBUG [RS:0;jenkins-hbase9:44465] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:26,014 DEBUG [RS:0;jenkins-hbase9:44465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44465,1689322343497' 2023-07-14 08:12:26,014 DEBUG [RS:0;jenkins-hbase9:44465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:26,015 DEBUG [RS:2;jenkins-hbase9:43891] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 08:12:26,016 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 08:12:26,016 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 08:12:26,016 DEBUG [RS:2;jenkins-hbase9:43891] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:26,016 DEBUG [RS:2;jenkins-hbase9:43891] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43891,1689322343628' 2023-07-14 08:12:26,016 DEBUG [RS:2;jenkins-hbase9:43891] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:26,016 DEBUG [RS:0;jenkins-hbase9:44465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:26,016 DEBUG [RS:2;jenkins-hbase9:43891] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:26,017 DEBUG [RS:0;jenkins-hbase9:44465] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 08:12:26,017 DEBUG [RS:2;jenkins-hbase9:43891] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 08:12:26,017 INFO [RS:0;jenkins-hbase9:44465] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 08:12:26,018 INFO [RS:2;jenkins-hbase9:43891] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 08:12:26,018 INFO [RS:0;jenkins-hbase9:44465] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 08:12:26,018 INFO [RS:2;jenkins-hbase9:43891] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 08:12:26,050 DEBUG [jenkins-hbase9:45715] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 08:12:26,056 DEBUG [jenkins-hbase9:45715] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:26,065 DEBUG [jenkins-hbase9:45715] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:26,065 DEBUG [jenkins-hbase9:45715] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:26,065 DEBUG [jenkins-hbase9:45715] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:26,065 DEBUG [jenkins-hbase9:45715] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:26,069 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39739,1689322343570, state=OPENING 2023-07-14 08:12:26,079 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 08:12:26,081 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:26,082 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 08:12:26,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:12:26,110 INFO [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39739%2C1689322343570, suffix=, logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,39739,1689322343570, archiveDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs, maxLogs=32 2023-07-14 08:12:26,123 INFO [RS:0;jenkins-hbase9:44465] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44465%2C1689322343497, suffix=, logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,44465,1689322343497, archiveDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs, maxLogs=32 2023-07-14 08:12:26,123 INFO [RS:2;jenkins-hbase9:43891] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43891%2C1689322343628, suffix=, logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,43891,1689322343628, archiveDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs, maxLogs=32 2023-07-14 08:12:26,146 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK] 2023-07-14 08:12:26,149 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK] 2023-07-14 08:12:26,149 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK] 2023-07-14 08:12:26,183 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK] 2023-07-14 08:12:26,183 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK] 2023-07-14 08:12:26,183 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK] 2023-07-14 08:12:26,200 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK] 2023-07-14 08:12:26,200 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK] 2023-07-14 08:12:26,201 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK] 2023-07-14 08:12:26,202 INFO [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,39739,1689322343570/jenkins-hbase9.apache.org%2C39739%2C1689322343570.1689322346112 2023-07-14 08:12:26,202 DEBUG [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK], DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK], DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK]] 2023-07-14 08:12:26,215 INFO [RS:0;jenkins-hbase9:44465] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,44465,1689322343497/jenkins-hbase9.apache.org%2C44465%2C1689322343497.1689322346125 2023-07-14 08:12:26,216 DEBUG [RS:0;jenkins-hbase9:44465] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK], DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK], DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK]] 2023-07-14 08:12:26,217 INFO [RS:2;jenkins-hbase9:43891] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,43891,1689322343628/jenkins-hbase9.apache.org%2C43891%2C1689322343628.1689322346126 2023-07-14 08:12:26,219 DEBUG [RS:2;jenkins-hbase9:43891] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK], DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK], DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK]] 2023-07-14 08:12:26,285 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:26,288 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:12:26,293 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:12:26,310 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 08:12:26,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:26,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39739%2C1689322343570.meta, suffix=.meta, logDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,39739,1689322343570, archiveDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs, maxLogs=32 2023-07-14 08:12:26,347 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK] 2023-07-14 08:12:26,347 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK] 2023-07-14 08:12:26,350 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK] 2023-07-14 08:12:26,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/WALs/jenkins-hbase9.apache.org,39739,1689322343570/jenkins-hbase9.apache.org%2C39739%2C1689322343570.meta.1689322346317.meta 2023-07-14 08:12:26,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33111,DS-09c50095-e2a7-4c7e-b7fa-10c8405ffbbb,DISK], DatanodeInfoWithStorage[127.0.0.1:43493,DS-49fe8f00-9e27-4f3d-b56e-d8729ee16f1c,DISK], DatanodeInfoWithStorage[127.0.0.1:38397,DS-5667e5c7-4a91-489b-9983-e58ffea038e6,DISK]] 2023-07-14 08:12:26,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:26,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 08:12:26,366 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:26,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 08:12:26,370 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 08:12:26,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 08:12:26,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 08:12:26,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:26,388 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 08:12:26,388 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 08:12:26,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 08:12:26,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/info 2023-07-14 08:12:26,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/info 2023-07-14 08:12:26,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 08:12:26,398 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:26,398 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 08:12:26,399 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/rep_barrier 2023-07-14 08:12:26,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/rep_barrier 2023-07-14 08:12:26,400 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 08:12:26,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:26,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 08:12:26,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/table 2023-07-14 08:12:26,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/table 2023-07-14 08:12:26,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 08:12:26,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:26,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740 2023-07-14 08:12:26,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740 2023-07-14 08:12:26,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 08:12:26,415 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 08:12:26,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63322191, jitterRate=-0.056425824761390686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 08:12:26,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 08:12:26,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689322346275 2023-07-14 08:12:26,467 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 08:12:26,468 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 08:12:26,469 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39739,1689322343570, state=OPEN 2023-07-14 08:12:26,473 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 08:12:26,474 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 08:12:26,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 08:12:26,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39739,1689322343570 in 388 msec 2023-07-14 08:12:26,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 08:12:26,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 634 msec 2023-07-14 08:12:26,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2330 sec 2023-07-14 08:12:26,492 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689322346492, completionTime=-1 2023-07-14 08:12:26,492 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 08:12:26,492 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 08:12:26,575 DEBUG [hconnection-0x291cea62-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:26,584 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:26,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 08:12:26,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689322406615 2023-07-14 08:12:26,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689322466615 2023-07-14 08:12:26,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-07-14 08:12:26,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45715,1689322341751-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45715,1689322341751-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45715,1689322341751-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,648 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:45715, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,649 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,658 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 08:12:26,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 08:12:26,676 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:26,688 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 08:12:26,693 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:26,698 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:26,728 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:26,731 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536 empty. 2023-07-14 08:12:26,732 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:26,732 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 08:12:26,783 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:26,785 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 515681d4dd0e8a9929ac3d280c7e2536, NAME => 'hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:12:26,807 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:26,807 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 515681d4dd0e8a9929ac3d280c7e2536, disabling compactions & flushes 2023-07-14 08:12:26,807 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:26,807 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:26,807 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. after waiting 0 ms 2023-07-14 08:12:26,807 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:26,807 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:26,807 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 515681d4dd0e8a9929ac3d280c7e2536: 2023-07-14 08:12:26,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:26,830 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689322346815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322346815"}]},"ts":"1689322346815"} 2023-07-14 08:12:26,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 08:12:26,865 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:26,872 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322346866"}]},"ts":"1689322346866"} 2023-07-14 08:12:26,879 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 08:12:26,884 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:26,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:26,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:26,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:26,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:26,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=515681d4dd0e8a9929ac3d280c7e2536, ASSIGN}] 2023-07-14 08:12:26,891 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=515681d4dd0e8a9929ac3d280c7e2536, ASSIGN 2023-07-14 08:12:26,893 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=515681d4dd0e8a9929ac3d280c7e2536, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39739,1689322343570; forceNewPlan=false, retain=false 2023-07-14 08:12:27,045 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 08:12:27,047 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=515681d4dd0e8a9929ac3d280c7e2536, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:27,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689322347046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322347046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322347046"}]},"ts":"1689322347046"} 2023-07-14 08:12:27,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 515681d4dd0e8a9929ac3d280c7e2536, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:12:27,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:27,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 515681d4dd0e8a9929ac3d280c7e2536, NAME => 'hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:27,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. service=AccessControlService 2023-07-14 08:12:27,214 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:27,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:27,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,218 INFO [StoreOpener-515681d4dd0e8a9929ac3d280c7e2536-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,220 DEBUG [StoreOpener-515681d4dd0e8a9929ac3d280c7e2536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/info 2023-07-14 08:12:27,220 DEBUG [StoreOpener-515681d4dd0e8a9929ac3d280c7e2536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/info 2023-07-14 08:12:27,221 INFO [StoreOpener-515681d4dd0e8a9929ac3d280c7e2536-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 515681d4dd0e8a9929ac3d280c7e2536 columnFamilyName info 2023-07-14 08:12:27,222 INFO [StoreOpener-515681d4dd0e8a9929ac3d280c7e2536-1] regionserver.HStore(310): Store=515681d4dd0e8a9929ac3d280c7e2536/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:27,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:12:27,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:27,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 515681d4dd0e8a9929ac3d280c7e2536; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71376201, jitterRate=0.06358827650547028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:27,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 515681d4dd0e8a9929ac3d280c7e2536: 2023-07-14 08:12:27,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536., pid=6, masterSystemTime=1689322347206 2023-07-14 08:12:27,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:27,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:12:27,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=515681d4dd0e8a9929ac3d280c7e2536, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:27,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689322347243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322347243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322347243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322347243"}]},"ts":"1689322347243"} 2023-07-14 08:12:27,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 08:12:27,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 515681d4dd0e8a9929ac3d280c7e2536, server=jenkins-hbase9.apache.org,39739,1689322343570 in 197 msec 2023-07-14 08:12:27,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 08:12:27,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=515681d4dd0e8a9929ac3d280c7e2536, ASSIGN in 367 msec 2023-07-14 08:12:27,261 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:27,261 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322347261"}]},"ts":"1689322347261"} 2023-07-14 08:12:27,264 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 08:12:27,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:27,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 592 msec 2023-07-14 08:12:27,293 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 08:12:27,294 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 08:12:27,294 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:27,330 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 08:12:27,349 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 08:12:27,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-14 08:12:27,364 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 08:12:27,377 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 08:12:27,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-14 08:12:27,391 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 08:12:27,394 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 08:12:27,394 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.675sec 2023-07-14 08:12:27,398 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 08:12:27,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 08:12:27,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 08:12:27,401 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45715,1689322341751-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 08:12:27,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45715,1689322341751-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 08:12:27,423 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:27,426 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 08:12:27,429 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:27,431 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:27,434 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 08:12:27,435 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44 empty. 2023-07-14 08:12:27,438 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,438 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 08:12:27,446 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:27,461 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:27,463 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9463064d38a2a0e09e02f6f1468f2a44, NAME => 'hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:12:27,486 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:27,486 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 9463064d38a2a0e09e02f6f1468f2a44, disabling compactions & flushes 2023-07-14 08:12:27,486 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,486 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,486 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. after waiting 0 ms 2023-07-14 08:12:27,486 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,486 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,486 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 9463064d38a2a0e09e02f6f1468f2a44: 2023-07-14 08:12:27,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:27,492 DEBUG [Listener at localhost/36375] zookeeper.ReadOnlyZKClient(139): Connect 0x6fb7de76 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:27,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689322347494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322347494"}]},"ts":"1689322347494"} 2023-07-14 08:12:27,502 DEBUG [Listener at localhost/36375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c9a8426, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:27,502 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 08:12:27,504 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:27,505 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322347504"}]},"ts":"1689322347504"} 2023-07-14 08:12:27,511 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 08:12:27,517 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:27,519 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:27,519 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:27,520 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:27,520 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:27,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9463064d38a2a0e09e02f6f1468f2a44, ASSIGN}] 2023-07-14 08:12:27,521 DEBUG [hconnection-0x1d21d95d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:27,523 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9463064d38a2a0e09e02f6f1468f2a44, ASSIGN 2023-07-14 08:12:27,525 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=9463064d38a2a0e09e02f6f1468f2a44, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:12:27,537 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/test.cache.data in system properties and HBase conf 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop.log.dir in system properties and HBase conf 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 08:12:27,541 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/nfs.dump.dir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir in system properties and HBase conf 2023-07-14 08:12:27,542 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:27,543 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 08:12:27,543 INFO [Listener at localhost/36375] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 08:12:27,554 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:27,676 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 08:12:27,677 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9463064d38a2a0e09e02f6f1468f2a44, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:27,678 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689322347677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322347677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322347677"}]},"ts":"1689322347677"} 2023-07-14 08:12:27,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 9463064d38a2a0e09e02f6f1468f2a44, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:12:27,754 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:27,847 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:27,847 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:12:27,851 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:12:27,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9463064d38a2a0e09e02f6f1468f2a44, NAME => 'hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:27,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. service=AccessControlService 2023-07-14 08:12:27,861 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:27,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:27,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,865 INFO [StoreOpener-9463064d38a2a0e09e02f6f1468f2a44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,868 DEBUG [StoreOpener-9463064d38a2a0e09e02f6f1468f2a44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/l 2023-07-14 08:12:27,868 DEBUG [StoreOpener-9463064d38a2a0e09e02f6f1468f2a44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/l 2023-07-14 08:12:27,869 INFO [StoreOpener-9463064d38a2a0e09e02f6f1468f2a44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9463064d38a2a0e09e02f6f1468f2a44 columnFamilyName l 2023-07-14 08:12:27,870 INFO [StoreOpener-9463064d38a2a0e09e02f6f1468f2a44-1] regionserver.HStore(310): Store=9463064d38a2a0e09e02f6f1468f2a44/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:27,879 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,882 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:12:27,902 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:27,903 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9463064d38a2a0e09e02f6f1468f2a44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74648510, jitterRate=0.1123494803905487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:27,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9463064d38a2a0e09e02f6f1468f2a44: 2023-07-14 08:12:27,905 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44., pid=11, masterSystemTime=1689322347847 2023-07-14 08:12:27,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,917 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:12:27,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9463064d38a2a0e09e02f6f1468f2a44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:27,920 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689322347920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322347920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322347920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322347920"}]},"ts":"1689322347920"} 2023-07-14 08:12:27,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 08:12:27,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 9463064d38a2a0e09e02f6f1468f2a44, server=jenkins-hbase9.apache.org,44465,1689322343497 in 242 msec 2023-07-14 08:12:27,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 08:12:27,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=9463064d38a2a0e09e02f6f1468f2a44, ASSIGN in 410 msec 2023-07-14 08:12:27,945 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:27,945 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322347945"}]},"ts":"1689322347945"} 2023-07-14 08:12:27,949 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 08:12:27,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:27,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 529 msec 2023-07-14 08:12:28,085 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:28,087 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 08:12:28,103 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 08:12:29,256 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:29,634 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:29,641 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_45455_jobhistory____.nabw95/webapp 2023-07-14 08:12:29,839 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 08:12:29,839 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:29,839 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:29,843 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:29,936 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:30,307 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:30,705 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 08:12:30,771 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:45455 2023-07-14 08:12:32,015 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:12:32,368 WARN [Listener at jenkins-hbase9.apache.org/44921] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:32,384 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 08:12:32,385 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 08:12:32,386 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 08:12:32,388 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:32,388 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 08:12:32,388 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:32,389 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 08:12:32,389 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 08:12:32,389 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 08:12:32,389 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:32,389 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 08:12:32,389 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 08:12:32,389 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 08:12:32,467 WARN [Listener at jenkins-hbase9.apache.org/44921] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 08:12:32,468 INFO [Listener at jenkins-hbase9.apache.org/44921] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:32,475 INFO [Listener at jenkins-hbase9.apache.org/44921] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_41793_cluster____obq9px/webapp 2023-07-14 08:12:32,548 INFO [Listener at jenkins-hbase9.apache.org/44921] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:32,548 INFO [Listener at jenkins-hbase9.apache.org/44921] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 08:12:32,548 INFO [Listener at jenkins-hbase9.apache.org/44921] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:32,548 INFO [Listener at jenkins-hbase9.apache.org/44921] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:32,557 INFO [Listener at jenkins-hbase9.apache.org/44921] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:32,775 INFO [Listener at jenkins-hbase9.apache.org/44921] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:32,906 INFO [Listener at jenkins-hbase9.apache.org/44921] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:32,917 INFO [Listener at jenkins-hbase9.apache.org/44921] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:41793 2023-07-14 08:12:33,651 WARN [Listener at jenkins-hbase9.apache.org/39889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:33,679 WARN [Listener at jenkins-hbase9.apache.org/39889] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 08:12:33,680 INFO [Listener at jenkins-hbase9.apache.org/39889] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:33,690 INFO [Listener at jenkins-hbase9.apache.org/39889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_35821_node____3w4fce/webapp 2023-07-14 08:12:33,756 INFO [Listener at jenkins-hbase9.apache.org/39889] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 08:12:33,757 INFO [Listener at jenkins-hbase9.apache.org/39889] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:33,757 INFO [Listener at jenkins-hbase9.apache.org/39889] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:33,757 INFO [Listener at jenkins-hbase9.apache.org/39889] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:33,770 INFO [Listener at jenkins-hbase9.apache.org/39889] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,791 INFO [Listener at jenkins-hbase9.apache.org/39889] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,877 INFO [Listener at jenkins-hbase9.apache.org/39889] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,923 INFO [Listener at jenkins-hbase9.apache.org/39889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:35821 2023-07-14 08:12:34,365 WARN [Listener at jenkins-hbase9.apache.org/36457] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:34,372 WARN [Listener at jenkins-hbase9.apache.org/36457] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 08:12:34,372 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:34,385 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_42389_node____onid5b/webapp 2023-07-14 08:12:34,455 INFO [Listener at jenkins-hbase9.apache.org/36457] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 08:12:34,455 INFO [Listener at jenkins-hbase9.apache.org/36457] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:34,456 INFO [Listener at jenkins-hbase9.apache.org/36457] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:34,456 INFO [Listener at jenkins-hbase9.apache.org/36457] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:34,472 INFO [Listener at jenkins-hbase9.apache.org/36457] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,495 INFO [Listener at jenkins-hbase9.apache.org/36457] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,599 INFO [Listener at jenkins-hbase9.apache.org/36457] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,624 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:42389 2023-07-14 08:12:34,662 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 08:12:34,664 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:34,791 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=647, ProcessCount=183, AvailableMemoryMB=2670 2023-07-14 08:12:34,791 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-14 08:12:34,819 DEBUG [Listener at jenkins-hbase9.apache.org/36457] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 08:12:34,830 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 08:12:34,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:34,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:34,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:34,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 08:12:34,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:34,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:34,856 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:34,857 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:34,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 empty. 2023-07-14 08:12:34,865 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 empty. 2023-07-14 08:12:34,866 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:34,867 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:34,867 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 08:12:34,926 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:34,931 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f6e65dffbe74e6c233f7cd5ef92f1d34, NAME => 'testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:12:34,936 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => eeeb04f83940bf718026111327fd2b45, NAME => 'testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:12:34,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,027 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing eeeb04f83940bf718026111327fd2b45, disabling compactions & flushes 2023-07-14 08:12:35,028 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,029 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. after waiting 0 ms 2023-07-14 08:12:35,029 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,029 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,029 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for eeeb04f83940bf718026111327fd2b45: 2023-07-14 08:12:35,039 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,039 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f6e65dffbe74e6c233f7cd5ef92f1d34, disabling compactions & flushes 2023-07-14 08:12:35,039 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,039 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,039 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. after waiting 0 ms 2023-07-14 08:12:35,040 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,040 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,040 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f6e65dffbe74e6c233f7cd5ef92f1d34: 2023-07-14 08:12:35,045 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:35,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355047"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322355047"}]},"ts":"1689322355047"} 2023-07-14 08:12:35,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355047"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322355047"}]},"ts":"1689322355047"} 2023-07-14 08:12:35,117 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:12:35,119 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:35,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322355120"}]},"ts":"1689322355120"} 2023-07-14 08:12:35,123 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 08:12:35,130 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:35,134 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:35,134 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:35,134 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:35,134 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:35,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, ASSIGN}] 2023-07-14 08:12:35,143 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, ASSIGN 2023-07-14 08:12:35,143 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, ASSIGN 2023-07-14 08:12:35,146 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43891,1689322343628; forceNewPlan=false, retain=false 2023-07-14 08:12:35,148 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:12:35,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,296 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:12:35,299 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=eeeb04f83940bf718026111327fd2b45, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:35,299 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f6e65dffbe74e6c233f7cd5ef92f1d34, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:35,299 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322355299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322355299"}]},"ts":"1689322355299"} 2023-07-14 08:12:35,299 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322355299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322355299"}]},"ts":"1689322355299"} 2023-07-14 08:12:35,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure f6e65dffbe74e6c233f7cd5ef92f1d34, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:12:35,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure eeeb04f83940bf718026111327fd2b45, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:12:35,460 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:35,460 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:12:35,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,466 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:12:35,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f6e65dffbe74e6c233f7cd5ef92f1d34, NAME => 'testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:12:35,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. service=AccessControlService 2023-07-14 08:12:35,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:35,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,479 INFO [StoreOpener-f6e65dffbe74e6c233f7cd5ef92f1d34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eeeb04f83940bf718026111327fd2b45, NAME => 'testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:12:35,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. service=AccessControlService 2023-07-14 08:12:35,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:35,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,481 DEBUG [StoreOpener-f6e65dffbe74e6c233f7cd5ef92f1d34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf 2023-07-14 08:12:35,481 DEBUG [StoreOpener-f6e65dffbe74e6c233f7cd5ef92f1d34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf 2023-07-14 08:12:35,482 INFO [StoreOpener-eeeb04f83940bf718026111327fd2b45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,482 INFO [StoreOpener-f6e65dffbe74e6c233f7cd5ef92f1d34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6e65dffbe74e6c233f7cd5ef92f1d34 columnFamilyName cf 2023-07-14 08:12:35,483 INFO [StoreOpener-f6e65dffbe74e6c233f7cd5ef92f1d34-1] regionserver.HStore(310): Store=f6e65dffbe74e6c233f7cd5ef92f1d34/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:35,484 DEBUG [StoreOpener-eeeb04f83940bf718026111327fd2b45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf 2023-07-14 08:12:35,486 DEBUG [StoreOpener-eeeb04f83940bf718026111327fd2b45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf 2023-07-14 08:12:35,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,486 INFO [StoreOpener-eeeb04f83940bf718026111327fd2b45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eeeb04f83940bf718026111327fd2b45 columnFamilyName cf 2023-07-14 08:12:35,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,488 INFO [StoreOpener-eeeb04f83940bf718026111327fd2b45-1] regionserver.HStore(310): Store=eeeb04f83940bf718026111327fd2b45/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:35,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:35,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:35,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:35,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f6e65dffbe74e6c233f7cd5ef92f1d34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69434659, jitterRate=0.03465704619884491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f6e65dffbe74e6c233f7cd5ef92f1d34: 2023-07-14 08:12:35,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34., pid=15, masterSystemTime=1689322355456 2023-07-14 08:12:35,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened eeeb04f83940bf718026111327fd2b45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69333196, jitterRate=0.033145129680633545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:35,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for eeeb04f83940bf718026111327fd2b45: 2023-07-14 08:12:35,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45., pid=16, masterSystemTime=1689322355460 2023-07-14 08:12:35,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:35,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f6e65dffbe74e6c233f7cd5ef92f1d34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:35,537 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322355535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322355535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322355535"}]},"ts":"1689322355535"} 2023-07-14 08:12:35,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=eeeb04f83940bf718026111327fd2b45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:35,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:35,539 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355538"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322355538"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322355538"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322355538"}]},"ts":"1689322355538"} 2023-07-14 08:12:35,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-14 08:12:35,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure f6e65dffbe74e6c233f7cd5ef92f1d34, server=jenkins-hbase9.apache.org,44465,1689322343497 in 240 msec 2023-07-14 08:12:35,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-14 08:12:35,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure eeeb04f83940bf718026111327fd2b45, server=jenkins-hbase9.apache.org,43891,1689322343628 in 245 msec 2023-07-14 08:12:35,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, ASSIGN in 418 msec 2023-07-14 08:12:35,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-14 08:12:35,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, ASSIGN in 421 msec 2023-07-14 08:12:35,583 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:35,583 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322355583"}]},"ts":"1689322355583"} 2023-07-14 08:12:35,586 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 08:12:35,592 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:35,599 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 08:12:35,616 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:35,622 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:35,629 DEBUG [hconnection-0x2591af0d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:35,635 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-14 08:12:35,645 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 08:12:35,696 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,696 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,696 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,696 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,696 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 875 msec 2023-07-14 08:12:35,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,968 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 08:12:35,968 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-14 08:12:35,969 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:35,975 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-14 08:12:35,976 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:35,976 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-14 08:12:35,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:35,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322355993 (current time:1689322355993). 2023-07-14 08:12:35,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:12:35,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x5a25c979 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:36,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a691143, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:36,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,019 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a25c979 to 127.0.0.1:54201 2023-07-14 08:12:36,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:36,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x6d0c29e4 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:36,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39aa35b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:36,033 DEBUG [hconnection-0x4f691ddb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,034 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,040 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d0c29e4 to 127.0.0.1:54201 2023-07-14 08:12:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 08:12:36,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:12:36,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,099 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,100 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689322956100 2023-07-14 08:12:36,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 08:12:36,106 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,110 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:12:36,110 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:12:36,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 21 msec 2023-07-14 08:12:36,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,114 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,115 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689322956115 2023-07-14 08:12:36,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,180 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 08:12:36,180 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,181 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 08:12:36,181 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 08:12:36,181 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,182 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,192 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,192 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,192 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,192 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,193 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,193 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,194 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,194 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:12:36,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 08:12:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 08:12:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 08:12:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,202 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,202 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,203 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,203 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,203 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,204 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,205 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,205 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,208 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,208 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,208 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,210 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:36,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:36,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:36,216 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,216 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:12:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,218 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,218 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,218 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,220 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,220 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,220 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,221 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,220 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,222 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,223 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:36,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee34f7c[Count = 1] remaining members to acquire global barrier 2023-07-14 08:12:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:36,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee34f7c[Count = 0] remaining members to acquire global barrier 2023-07-14 08:12:36,229 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 08:12:36,229 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,232 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,233 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,233 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:12:36,233 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,240 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,240 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,240 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,240 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:12:36,244 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:36,244 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:36,244 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:36,244 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:36,244 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:36,245 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:36,245 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. started... 2023-07-14 08:12:36,245 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. started... 2023-07-14 08:12:36,248 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,248 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,248 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:36,250 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eeeb04f83940bf718026111327fd2b45: 2023-07-14 08:12:36,250 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6e65dffbe74e6c233f7cd5ef92f1d34: 2023-07-14 08:12:36,251 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,251 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,257 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:36,257 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:36,260 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:12:36,260 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:12:36,292 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. completed. 2023-07-14 08:12:36,293 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:36,293 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:36,293 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:36,294 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,294 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,294 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:12:36,296 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:36,298 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. completed. 2023-07-14 08:12:36,298 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:36,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,298 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:36,299 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:36,299 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,299 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,299 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:12:36,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,301 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,301 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,301 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,302 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 08:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:12:36,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 08:12:36,314 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 08:12:36,314 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:12:36,314 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:12:36,314 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,314 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:12:36,317 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,317 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,318 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,318 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,320 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,321 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,322 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,325 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,326 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,327 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,344 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,344 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,344 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,344 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,344 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,345 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,345 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,345 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,344 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,345 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,345 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,345 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,345 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,348 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,348 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,348 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,348 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,348 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,416 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:36,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:36,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:36,418 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:12:36,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 08:12:36,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,557 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689322356101Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689322356345 (+244 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689322356347 (+2 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689322356366 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689322356414 (+48 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689322356556 (+142 ms) 2023-07-14 08:12:36,560 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 451 msec 2023-07-14 08:12:36,719 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:36,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:36,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:12:36,769 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,770 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,785 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,786 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44465] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:12:36,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43891] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:12:36,796 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 08:12:36,797 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:36,800 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:36,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322356842 (current time:1689322356842). 2023-07-14 08:12:36,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:12:36,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x670a3705 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:36,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68311afe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:36,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,878 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x670a3705 to 127.0.0.1:54201 2023-07-14 08:12:36,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:36,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x57c1751b to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:36,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6145c2f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:36,895 DEBUG [hconnection-0x143d2c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,898 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,905 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57c1751b to 127.0.0.1:54201 2023-07-14 08:12:36,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:36,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 08:12:36,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:12:36,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,915 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,916 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689322956916 2023-07-14 08:12:36,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,917 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 08:12:36,919 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:12:36,919 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:12:36,921 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-14 08:12:36,924 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,926 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689322956926 2023-07-14 08:12:36,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 08:12:36,961 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 08:12:36,961 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,963 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 08:12:36,963 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 08:12:36,964 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,964 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,965 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,965 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,965 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,965 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,966 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,966 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,967 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,967 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:12:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 08:12:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 08:12:36,968 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,968 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 08:12:36,968 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,968 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,970 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,970 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,970 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,970 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 08:12:36,970 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,971 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,971 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,971 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,972 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,972 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,972 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,975 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,975 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,976 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,976 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,977 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,977 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,978 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,978 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,978 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,978 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,978 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:36,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:36,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c27f102[Count = 1] remaining members to acquire global barrier 2023-07-14 08:12:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:36,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:36,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c27f102[Count = 0] remaining members to acquire global barrier 2023-07-14 08:12:36,986 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 08:12:36,986 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,994 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,994 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,994 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,995 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:12:36,996 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:36,995 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:36,996 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. started... 2023-07-14 08:12:36,995 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:36,996 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:36,996 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. started... 2023-07-14 08:12:36,996 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eeeb04f83940bf718026111327fd2b45 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-14 08:12:36,996 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f6e65dffbe74e6c233f7cd5ef92f1d34 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-14 08:12:36,996 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:36,996 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:12:36,999 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,999 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,999 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:37,020 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:37,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:37,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:37,021 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:12:37,166 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/.tmp/cf/f1e50ee089604ac496d83c3496a27f2a 2023-07-14 08:12:37,222 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:37,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:37,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:37,225 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:12:37,227 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/.tmp/cf/f1e50ee089604ac496d83c3496a27f2a as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf/f1e50ee089604ac496d83c3496a27f2a 2023-07-14 08:12:37,239 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf/f1e50ee089604ac496d83c3496a27f2a, entries=7, sequenceid=6, filesize=5.3 K 2023-07-14 08:12:37,241 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for f6e65dffbe74e6c233f7cd5ef92f1d34 in 245ms, sequenceid=6, compaction requested=false 2023-07-14 08:12:37,241 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 08:12:37,242 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6e65dffbe74e6c233f7cd5ef92f1d34: 2023-07-14 08:12:37,243 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:37,243 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:37,243 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf/f1e50ee089604ac496d83c3496a27f2a] hfiles 2023-07-14 08:12:37,243 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf/f1e50ee089604ac496d83c3496a27f2a for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:37,268 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. completed. 2023-07-14 08:12:37,268 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:37,268 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:37,269 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:37,269 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,270 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:37,270 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:12:37,275 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:37,275 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,275 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:37,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,275 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:12:37,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 08:12:37,526 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:37,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:37,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:37,528 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:12:37,570 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/.tmp/cf/aad4c4e60cde4dd4a8952eb6d908669a 2023-07-14 08:12:37,580 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/.tmp/cf/aad4c4e60cde4dd4a8952eb6d908669a as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf/aad4c4e60cde4dd4a8952eb6d908669a 2023-07-14 08:12:37,588 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf/aad4c4e60cde4dd4a8952eb6d908669a, entries=43, sequenceid=6, filesize=7.7 K 2023-07-14 08:12:37,591 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for eeeb04f83940bf718026111327fd2b45 in 595ms, sequenceid=6, compaction requested=false 2023-07-14 08:12:37,593 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eeeb04f83940bf718026111327fd2b45: 2023-07-14 08:12:37,593 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:37,593 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:37,593 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf/aad4c4e60cde4dd4a8952eb6d908669a] hfiles 2023-07-14 08:12:37,593 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf/aad4c4e60cde4dd4a8952eb6d908669a for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:37,615 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. completed. 2023-07-14 08:12:37,616 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:37,616 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:37,617 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:37,617 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,617 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:37,617 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:12:37,620 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,620 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:37,620 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:37,620 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:37,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:37,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:12:37,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 08:12:37,627 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 08:12:37,627 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:12:37,627 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:12:37,627 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 08:12:37,627 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:12:37,630 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,630 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:37,630 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,631 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:37,633 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,633 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,630 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:37,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:37,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:37,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:37,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:37,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:37,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:37,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:37,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,636 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,637 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:37,637 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:37,640 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,641 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,641 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:37,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:37,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:37,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:37,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:37,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:37,655 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:37,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:37,656 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:37,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:37,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:37,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:37,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 08:12:37,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:37,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 08:12:37,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:37,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:37,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 08:12:37,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,770 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689322356917Consolidate snapshot: snaptb0-testExportWithTargetName at 1689322357657 (+740 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689322357658 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689322357672 (+14 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689322357697 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689322357769 (+72 ms) 2023-07-14 08:12:37,773 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:37,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 855 msec 2023-07-14 08:12:38,028 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:38,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:38,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:12:38,032 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032 2023-07-14 08:12:38,032 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45081, tgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032, rawTgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:38,089 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:38,089 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1538570431_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 08:12:38,089 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 08:12:38,137 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 08:12:38,854 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:38,855 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:38,856 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:38,857 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,062 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-654897543117651597.jar 2023-07-14 08:12:40,063 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,063 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,137 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-7594735748668308222.jar 2023-07-14 08:12:40,137 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,138 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,138 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,139 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,139 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,140 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,140 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:12:40,141 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:12:40,141 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:12:40,142 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:12:40,142 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:12:40,143 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:12:40,144 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:12:40,144 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:12:40,145 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:12:40,146 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:12:40,150 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,151 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,151 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:12:40,152 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,152 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,153 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:12:40,154 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:12:41,010 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:12:42,292 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:12:42,301 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 08:12:42,315 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 08:12:42,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:12:42,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:12:43,371 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:49,923 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:52,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:55,740 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:57,319 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:12:57,321 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:12:57,335 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 08:12:57,335 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:12:57,336 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:12:57,336 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 08:12:57,337 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 08:12:57,337 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 08:12:57,337 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032/.hbase-snapshot/testExportWithTargetName 2023-07-14 08:12:57,338 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 08:12:57,338 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322358032/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 08:12:57,351 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 08:12:57,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 08:12:57,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 08:12:57,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322377379"}]},"ts":"1689322377379"} 2023-07-14 08:12:57,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 08:12:57,383 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 08:12:57,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, UNASSIGN}] 2023-07-14 08:12:57,390 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, UNASSIGN 2023-07-14 08:12:57,390 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, UNASSIGN 2023-07-14 08:12:57,392 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f6e65dffbe74e6c233f7cd5ef92f1d34, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:57,392 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322377392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322377392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322377392"}]},"ts":"1689322377392"} 2023-07-14 08:12:57,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=eeeb04f83940bf718026111327fd2b45, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:57,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322377393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322377393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322377393"}]},"ts":"1689322377393"} 2023-07-14 08:12:57,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure f6e65dffbe74e6c233f7cd5ef92f1d34, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:12:57,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure eeeb04f83940bf718026111327fd2b45, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:12:57,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 08:12:57,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:57,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing eeeb04f83940bf718026111327fd2b45, disabling compactions & flushes 2023-07-14 08:12:57,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:57,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:57,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. after waiting 0 ms 2023-07-14 08:12:57,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:57,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:12:57,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:57,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:57,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45. 2023-07-14 08:12:57,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for eeeb04f83940bf718026111327fd2b45: 2023-07-14 08:12:57,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f6e65dffbe74e6c233f7cd5ef92f1d34, disabling compactions & flushes 2023-07-14 08:12:57,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:57,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:57,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. after waiting 0 ms 2023-07-14 08:12:57,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:57,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:57,585 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=eeeb04f83940bf718026111327fd2b45, regionState=CLOSED 2023-07-14 08:12:57,585 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322377584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322377584"}]},"ts":"1689322377584"} 2023-07-14 08:12:57,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-14 08:12:57,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure eeeb04f83940bf718026111327fd2b45, server=jenkins-hbase9.apache.org,43891,1689322343628 in 189 msec 2023-07-14 08:12:57,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eeeb04f83940bf718026111327fd2b45, UNASSIGN in 213 msec 2023-07-14 08:12:57,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:12:57,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:57,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34. 2023-07-14 08:12:57,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f6e65dffbe74e6c233f7cd5ef92f1d34: 2023-07-14 08:12:57,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:57,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f6e65dffbe74e6c233f7cd5ef92f1d34, regionState=CLOSED 2023-07-14 08:12:57,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322377618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322377618"}]},"ts":"1689322377618"} 2023-07-14 08:12:57,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-14 08:12:57,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure f6e65dffbe74e6c233f7cd5ef92f1d34, server=jenkins-hbase9.apache.org,44465,1689322343497 in 231 msec 2023-07-14 08:12:57,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-14 08:12:57,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6e65dffbe74e6c233f7cd5ef92f1d34, UNASSIGN in 245 msec 2023-07-14 08:12:57,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322377635"}]},"ts":"1689322377635"} 2023-07-14 08:12:57,638 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 08:12:57,640 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 08:12:57,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 281 msec 2023-07-14 08:12:57,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 08:12:57,683 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 08:12:57,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 08:12:57,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,705 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 08:12:57,707 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,724 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 08:12:57,728 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,728 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,728 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,728 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,730 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:57,730 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 08:12:57,730 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 08:12:57,730 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 08:12:57,730 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 08:12:57,734 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:57,736 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:57,738 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/recovered.edits] 2023-07-14 08:12:57,741 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/recovered.edits] 2023-07-14 08:12:57,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 08:12:57,750 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf/f1e50ee089604ac496d83c3496a27f2a to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/cf/f1e50ee089604ac496d83c3496a27f2a 2023-07-14 08:12:57,750 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf/aad4c4e60cde4dd4a8952eb6d908669a to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/cf/aad4c4e60cde4dd4a8952eb6d908669a 2023-07-14 08:12:57,763 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34/recovered.edits/9.seqid 2023-07-14 08:12:57,764 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45/recovered.edits/9.seqid 2023-07-14 08:12:57,764 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/f6e65dffbe74e6c233f7cd5ef92f1d34 2023-07-14 08:12:57,765 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportWithTargetName/eeeb04f83940bf718026111327fd2b45 2023-07-14 08:12:57,766 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 08:12:57,770 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,814 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 08:12:57,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 08:12:57,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 08:12:57,826 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322377825"}]},"ts":"9223372036854775807"} 2023-07-14 08:12:57,826 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322377825"}]},"ts":"9223372036854775807"} 2023-07-14 08:12:57,834 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:12:57,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f6e65dffbe74e6c233f7cd5ef92f1d34, NAME => 'testtb-testExportWithTargetName,,1689322354839.f6e65dffbe74e6c233f7cd5ef92f1d34.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => eeeb04f83940bf718026111327fd2b45, NAME => 'testtb-testExportWithTargetName,1,1689322354839.eeeb04f83940bf718026111327fd2b45.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:12:57,834 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 08:12:57,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322377835"}]},"ts":"9223372036854775807"} 2023-07-14 08:12:57,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 08:12:57,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 08:12:57,844 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:57,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 153 msec 2023-07-14 08:12:58,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 08:12:58,045 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 08:12:58,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 08:12:58,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:58,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 08:12:58,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 08:12:58,121 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=751 (was 705) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:37874 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-34348623_1 at /127.0.0.1:45512 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1286 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-34348623_1 at /127.0.0.1:37840 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:39408 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:33059 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:43057 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:45530 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=699 (was 647) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=990 (was 2670) 2023-07-14 08:12:58,122 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 08:12:58,155 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=699, ProcessCount=189, AvailableMemoryMB=987 2023-07-14 08:12:58,155 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 08:12:58,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:58,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:12:58,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:58,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 08:12:58,165 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:58,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:12:58,168 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,168 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,169 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 empty. 2023-07-14 08:12:58,169 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b empty. 2023-07-14 08:12:58,170 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,170 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,170 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 08:12:58,229 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:58,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9e7e531ca6b725380702766321c97116, NAME => 'testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:12:58,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b56797d5a39282ab1ea88d2f8731f50b, NAME => 'testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:12:58,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:12:58,286 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:58,290 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b56797d5a39282ab1ea88d2f8731f50b, disabling compactions & flushes 2023-07-14 08:12:58,291 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,291 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,291 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. after waiting 0 ms 2023-07-14 08:12:58,293 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,293 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,293 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b56797d5a39282ab1ea88d2f8731f50b: 2023-07-14 08:12:58,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:58,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9e7e531ca6b725380702766321c97116, disabling compactions & flushes 2023-07-14 08:12:58,294 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. after waiting 0 ms 2023-07-14 08:12:58,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,294 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9e7e531ca6b725380702766321c97116: 2023-07-14 08:12:58,297 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:58,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322378298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322378298"}]},"ts":"1689322378298"} 2023-07-14 08:12:58,299 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322378298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322378298"}]},"ts":"1689322378298"} 2023-07-14 08:12:58,306 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:12:58,307 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:58,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322378307"}]},"ts":"1689322378307"} 2023-07-14 08:12:58,310 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 08:12:58,313 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:58,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:58,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:58,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:58,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:58,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, ASSIGN}] 2023-07-14 08:12:58,324 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, ASSIGN 2023-07-14 08:12:58,324 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, ASSIGN 2023-07-14 08:12:58,325 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39739,1689322343570; forceNewPlan=false, retain=false 2023-07-14 08:12:58,325 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:12:58,476 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:12:58,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b56797d5a39282ab1ea88d2f8731f50b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9e7e531ca6b725380702766321c97116, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322378479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322378479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322378479"}]},"ts":"1689322378479"} 2023-07-14 08:12:58,479 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322378479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322378479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322378479"}]},"ts":"1689322378479"} 2023-07-14 08:12:58,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:12:58,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure b56797d5a39282ab1ea88d2f8731f50b, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:12:58,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9e7e531ca6b725380702766321c97116, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:12:58,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b56797d5a39282ab1ea88d2f8731f50b, NAME => 'testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:12:58,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. service=AccessControlService 2023-07-14 08:12:58,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:58,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:58,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e7e531ca6b725380702766321c97116, NAME => 'testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:12:58,646 INFO [StoreOpener-b56797d5a39282ab1ea88d2f8731f50b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. service=AccessControlService 2023-07-14 08:12:58,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:58,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:58,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,648 DEBUG [StoreOpener-b56797d5a39282ab1ea88d2f8731f50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf 2023-07-14 08:12:58,648 DEBUG [StoreOpener-b56797d5a39282ab1ea88d2f8731f50b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf 2023-07-14 08:12:58,648 INFO [StoreOpener-b56797d5a39282ab1ea88d2f8731f50b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b56797d5a39282ab1ea88d2f8731f50b columnFamilyName cf 2023-07-14 08:12:58,649 INFO [StoreOpener-b56797d5a39282ab1ea88d2f8731f50b-1] regionserver.HStore(310): Store=b56797d5a39282ab1ea88d2f8731f50b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:58,649 INFO [StoreOpener-9e7e531ca6b725380702766321c97116-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,656 DEBUG [StoreOpener-9e7e531ca6b725380702766321c97116-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf 2023-07-14 08:12:58,657 DEBUG [StoreOpener-9e7e531ca6b725380702766321c97116-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf 2023-07-14 08:12:58,657 INFO [StoreOpener-9e7e531ca6b725380702766321c97116-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e7e531ca6b725380702766321c97116 columnFamilyName cf 2023-07-14 08:12:58,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:12:58,658 INFO [StoreOpener-9e7e531ca6b725380702766321c97116-1] regionserver.HStore(310): Store=9e7e531ca6b725380702766321c97116/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:58,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9e7e531ca6b725380702766321c97116 2023-07-14 08:12:58,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:58,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:58,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b56797d5a39282ab1ea88d2f8731f50b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65431380, jitterRate=-0.024996459484100342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:58,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b56797d5a39282ab1ea88d2f8731f50b: 2023-07-14 08:12:58,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9e7e531ca6b725380702766321c97116; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74959956, jitterRate=0.11699038743972778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:58,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9e7e531ca6b725380702766321c97116: 2023-07-14 08:12:58,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b., pid=30, masterSystemTime=1689322378634 2023-07-14 08:12:58,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116., pid=31, masterSystemTime=1689322378636 2023-07-14 08:12:58,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b56797d5a39282ab1ea88d2f8731f50b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,675 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322378674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322378674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322378674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322378674"}]},"ts":"1689322378674"} 2023-07-14 08:12:58,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,677 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9e7e531ca6b725380702766321c97116, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,678 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322378677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322378677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322378677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322378677"}]},"ts":"1689322378677"} 2023-07-14 08:12:58,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-14 08:12:58,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure b56797d5a39282ab1ea88d2f8731f50b, server=jenkins-hbase9.apache.org,44465,1689322343497 in 197 msec 2023-07-14 08:12:58,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-14 08:12:58,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9e7e531ca6b725380702766321c97116, server=jenkins-hbase9.apache.org,39739,1689322343570 in 199 msec 2023-07-14 08:12:58,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, ASSIGN in 367 msec 2023-07-14 08:12:58,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-14 08:12:58,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, ASSIGN in 393 msec 2023-07-14 08:12:58,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:58,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322378727"}]},"ts":"1689322378727"} 2023-07-14 08:12:58,729 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 08:12:58,733 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:58,733 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 08:12:58,736 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:12:58,739 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:58,739 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:58,740 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:58,740 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:58,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:12:58,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:12:58,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:12:58,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:58,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:58,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:58,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:58,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 585 msec 2023-07-14 08:12:58,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:12:58,781 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 08:12:58,781 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 08:12:58,782 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:58,786 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 08:12:58,786 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:58,786 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-14 08:12:58,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:12:58,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322378798 (current time:1689322378798). 2023-07-14 08:12:58,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:12:58,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x5caf86fc to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:58,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c2e9629, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:58,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:58,808 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:58,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5caf86fc to 127.0.0.1:54201 2023-07-14 08:12:58,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:58,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x6780ec7c to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:58,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47b81e16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:58,820 DEBUG [hconnection-0x2f4f4716-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:58,824 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:58,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:58,830 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:58,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6780ec7c to 127.0.0.1:54201 2023-07-14 08:12:58,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:58,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:12:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:12:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:12:58,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:12:58,837 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:12:58,838 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689322978838 2023-07-14 08:12:58,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 08:12:58,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:12:58,840 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:12:58,840 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:12:58,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:12:58,843 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:12:58,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-14 08:12:58,846 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:12:58,847 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689322978847 2023-07-14 08:12:58,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,860 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 08:12:58,860 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:58,861 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 08:12:58,861 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:12:58,862 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,862 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,863 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:58,863 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:58,863 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:58,863 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:58,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:58,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:58,863 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,864 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,864 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,864 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,865 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:58,865 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:12:58,866 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:12:58,866 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:12:58,866 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 08:12:58,866 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:58,865 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:12:58,867 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:58,867 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:12:58,868 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:12:58,868 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:12:58,868 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:12:58,868 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 08:12:58,868 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 08:12:58,870 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,870 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:58,875 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,875 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2893659[Count = 1] remaining members to acquire global barrier 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:58,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:12:58,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2893659[Count = 0] remaining members to acquire global barrier 2023-07-14 08:12:58,880 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:12:58,880 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,881 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,881 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,881 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:12:58,882 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:58,882 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,882 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. started... 2023-07-14 08:12:58,882 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:12:58,883 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:58,883 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:58,883 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e7e531ca6b725380702766321c97116: 2023-07-14 08:12:58,883 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,883 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:12:58,883 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,883 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,883 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. started... 2023-07-14 08:12:58,883 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:58,884 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:12:58,884 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b56797d5a39282ab1ea88d2f8731f50b: 2023-07-14 08:12:58,884 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:12:58,884 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,884 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:58,885 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:58,885 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 08:12:58,885 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:12:58,896 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. completed. 2023-07-14 08:12:58,896 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:58,896 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:58,896 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:58,896 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,896 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 08:12:58,896 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:12:58,897 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. completed. 2023-07-14 08:12:58,897 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:58,897 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:58,897 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:58,898 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,898 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 08:12:58,898 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:12:58,899 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:12:58,899 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,899 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:58,899 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 08:12:58,901 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,901 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:12:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:58,901 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:58,901 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 08:12:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:58,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:58,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:58,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:12:58,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:12:58,908 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 08:12:58,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:12:58,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:12:58,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,908 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:58,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,911 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,910 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:58,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:58,911 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:58,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:58,912 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:58,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,915 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:58,915 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,915 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:58,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:58,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:58,918 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:58,919 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:58,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,919 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:58,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:58,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:58,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:58,919 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:58,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,919 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:58,920 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,920 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:58,920 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:58,920 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,920 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:58,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,940 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:58,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:12:58,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:58,942 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:12:58,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 08:12:58,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 08:12:58,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689322378839Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689322378919 (+80 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689322378920 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689322378924 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689322378938 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689322378965 (+27 ms) 2023-07-14 08:12:58,968 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:12:58,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 128 msec 2023-07-14 08:12:59,142 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:59,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:12:59,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:12:59,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44465] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:12:59,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39739] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:12:59,163 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 08:12:59,163 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:59,165 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:59,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:12:59,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322379182 (current time:1689322379182). 2023-07-14 08:12:59,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:12:59,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x768bdc3a to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:59,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18eba1e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:59,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:59,201 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:59,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x768bdc3a to 127.0.0.1:54201 2023-07-14 08:12:59,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:59,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x60cdbfa2 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:59,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2e89cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:59,216 DEBUG [hconnection-0x43fc86f7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:59,217 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:59,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:59,230 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:59,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60cdbfa2 to 127.0.0.1:54201 2023-07-14 08:12:59,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:59,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:12:59,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:12:59,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:12:59,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:12:59,238 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:12:59,242 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689322979242 2023-07-14 08:12:59,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:12:59,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 08:12:59,246 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:12:59,246 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:12:59,252 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:12:59,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:12:59,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 16 msec 2023-07-14 08:12:59,255 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:12:59,256 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689322979256 2023-07-14 08:12:59,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 08:12:59,279 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 08:12:59,279 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:59,281 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 08:12:59,281 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:12:59,337 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,338 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,340 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:59,340 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:59,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:59,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:59,340 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:59,340 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:59,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,341 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,341 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,341 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,341 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 08:12:59,342 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:12:59,343 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:12:59,343 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:59,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 08:12:59,344 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:12:59,344 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:12:59,344 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:12:59,344 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:59,343 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:59,345 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:12:59,347 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:12:59,344 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 08:12:59,347 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 08:12:59,347 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:59,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:12:59,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:12:59,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 08:12:59,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:12:59,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:59,349 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,350 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:59,353 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,353 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,353 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:12:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51040932[Count = 1] remaining members to acquire global barrier 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:59,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:12:59,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51040932[Count = 0] remaining members to acquire global barrier 2023-07-14 08:12:59,360 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:12:59,360 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,361 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,361 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:12:59,361 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:12:59,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,362 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 08:12:59,362 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:12:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,362 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:59,362 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:12:59,362 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. started... 2023-07-14 08:12:59,362 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:59,362 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:59,362 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,362 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9e7e531ca6b725380702766321c97116 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 08:12:59,362 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:12:59,363 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:59,363 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:59,363 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:59,363 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. started... 2023-07-14 08:12:59,363 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b56797d5a39282ab1ea88d2f8731f50b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 08:12:59,366 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:12:59,366 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:59,366 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 08:12:59,405 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/.tmp/cf/0a32ab48691e4967a2af8cea39ad30be 2023-07-14 08:12:59,406 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/.tmp/cf/b78982e4b8404ad49ed7b722758389d7 2023-07-14 08:12:59,418 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/.tmp/cf/0a32ab48691e4967a2af8cea39ad30be as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf/0a32ab48691e4967a2af8cea39ad30be 2023-07-14 08:12:59,428 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf/0a32ab48691e4967a2af8cea39ad30be, entries=46, sequenceid=6, filesize=7.9 K 2023-07-14 08:12:59,429 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/.tmp/cf/b78982e4b8404ad49ed7b722758389d7 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf/b78982e4b8404ad49ed7b722758389d7 2023-07-14 08:12:59,431 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b56797d5a39282ab1ea88d2f8731f50b in 68ms, sequenceid=6, compaction requested=false 2023-07-14 08:12:59,431 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 08:12:59,432 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b56797d5a39282ab1ea88d2f8731f50b: 2023-07-14 08:12:59,432 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:12:59,432 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:59,432 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf/0a32ab48691e4967a2af8cea39ad30be] hfiles 2023-07-14 08:12:59,432 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf/0a32ab48691e4967a2af8cea39ad30be for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:12:59,440 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf/b78982e4b8404ad49ed7b722758389d7, entries=4, sequenceid=6, filesize=5.1 K 2023-07-14 08:12:59,444 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9e7e531ca6b725380702766321c97116 in 82ms, sequenceid=6, compaction requested=false 2023-07-14 08:12:59,448 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e7e531ca6b725380702766321c97116: 2023-07-14 08:12:59,448 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:12:59,448 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:59,448 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf/b78982e4b8404ad49ed7b722758389d7] hfiles 2023-07-14 08:12:59,448 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf/b78982e4b8404ad49ed7b722758389d7 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:12:59,458 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. completed. 2023-07-14 08:12:59,458 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:12:59,458 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:59,458 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:59,458 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,458 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 08:12:59,458 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:12:59,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,464 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:12:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:59,464 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:59,465 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 08:12:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,468 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. completed. 2023-07-14 08:12:59,468 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:12:59,468 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:59,468 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:59,468 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,468 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 08:12:59,468 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:12:59,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:59,470 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:12:59,470 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:59,470 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 08:12:59,470 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:12:59,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:12:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:12:59,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:12:59,479 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 08:12:59,479 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:12:59,479 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:12:59,479 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 08:12:59,479 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:12:59,481 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,481 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:59,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,481 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,481 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:59,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,482 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:59,481 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,482 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:59,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:59,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:59,482 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,483 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:59,483 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,485 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,486 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:59,486 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:12:59,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:59,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:59,492 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:59,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:12:59,491 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:59,493 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:59,492 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:59,492 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 08:12:59,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:59,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 08:12:59,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:59,494 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:12:59,494 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:59,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:59,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:59,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:59,494 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:12:59,495 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,495 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 08:12:59,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,553 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689322379246Consolidate snapshot: snaptb0-testExportFileSystemState at 1689322379494 (+248 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689322379494Writing data manifest for snaptb0-testExportFileSystemState at 1689322379499 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689322379514 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689322379552 (+38 ms) 2023-07-14 08:12:59,554 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:59,555 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:12:59,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:12:59,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:12:59,560 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560 2023-07-14 08:12:59,560 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45081, tgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560, rawTgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:59,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 310 msec 2023-07-14 08:12:59,585 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:12:59,586 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-921265881_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,586 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 08:12:59,599 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:12:59,638 WARN [DataStreamer for file /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-14 08:12:59,640 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:59,641 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:59,642 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:59,642 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,715 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-4283212228695338350.jar 2023-07-14 08:13:00,716 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,716 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,792 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-4953314371558998175.jar 2023-07-14 08:13:00,793 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,793 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,794 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,794 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,794 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,795 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:00,795 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:13:00,796 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:13:00,796 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:13:00,797 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:13:00,797 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:13:00,798 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:13:00,798 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:13:00,798 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:13:00,799 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:13:00,799 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:13:00,800 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:00,800 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:00,801 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:00,801 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:00,802 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:00,802 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:00,803 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:01,521 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:13:01,525 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 08:13:01,528 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 08:13:01,994 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:01,994 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:02,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0001_000001 (auth:SIMPLE) 2023-07-14 08:13:02,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:03,199 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:13:07,905 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:10,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:15,218 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:16,839 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:13:16,843 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:13:16,859 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 08:13:16,859 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:13:16,860 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:13:16,860 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 08:13:16,861 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 08:13:16,861 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 08:13:16,861 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 08:13:16,862 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 08:13:16,862 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322379560/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 08:13:16,891 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 08:13:16,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 08:13:16,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:16,900 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322396900"}]},"ts":"1689322396900"} 2023-07-14 08:13:16,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 08:13:16,902 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 08:13:16,904 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 08:13:16,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, UNASSIGN}] 2023-07-14 08:13:16,907 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, UNASSIGN 2023-07-14 08:13:16,909 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, UNASSIGN 2023-07-14 08:13:16,910 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9e7e531ca6b725380702766321c97116, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:16,910 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b56797d5a39282ab1ea88d2f8731f50b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:16,910 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322396910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322396910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322396910"}]},"ts":"1689322396910"} 2023-07-14 08:13:16,910 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322396910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322396910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322396910"}]},"ts":"1689322396910"} 2023-07-14 08:13:16,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9e7e531ca6b725380702766321c97116, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:13:16,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure b56797d5a39282ab1ea88d2f8731f50b, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:13:17,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 08:13:17,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9e7e531ca6b725380702766321c97116 2023-07-14 08:13:17,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9e7e531ca6b725380702766321c97116, disabling compactions & flushes 2023-07-14 08:13:17,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:13:17,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:13:17,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. after waiting 0 ms 2023-07-14 08:13:17,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:13:17,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:13:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b56797d5a39282ab1ea88d2f8731f50b, disabling compactions & flushes 2023-07-14 08:13:17,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:13:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:13:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. after waiting 0 ms 2023-07-14 08:13:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:13:17,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:13:17,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:13:17,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:13:17,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:13:17,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b. 2023-07-14 08:13:17,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116. 2023-07-14 08:13:17,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b56797d5a39282ab1ea88d2f8731f50b: 2023-07-14 08:13:17,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9e7e531ca6b725380702766321c97116: 2023-07-14 08:13:17,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:13:17,098 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b56797d5a39282ab1ea88d2f8731f50b, regionState=CLOSED 2023-07-14 08:13:17,098 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322397098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322397098"}]},"ts":"1689322397098"} 2023-07-14 08:13:17,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9e7e531ca6b725380702766321c97116 2023-07-14 08:13:17,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9e7e531ca6b725380702766321c97116, regionState=CLOSED 2023-07-14 08:13:17,099 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322397099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322397099"}]},"ts":"1689322397099"} 2023-07-14 08:13:17,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-14 08:13:17,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-14 08:13:17,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure b56797d5a39282ab1ea88d2f8731f50b, server=jenkins-hbase9.apache.org,44465,1689322343497 in 186 msec 2023-07-14 08:13:17,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9e7e531ca6b725380702766321c97116, server=jenkins-hbase9.apache.org,39739,1689322343570 in 193 msec 2023-07-14 08:13:17,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e7e531ca6b725380702766321c97116, UNASSIGN in 206 msec 2023-07-14 08:13:17,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 08:13:17,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b56797d5a39282ab1ea88d2f8731f50b, UNASSIGN in 206 msec 2023-07-14 08:13:17,114 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322397114"}]},"ts":"1689322397114"} 2023-07-14 08:13:17,116 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 08:13:17,117 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 08:13:17,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 227 msec 2023-07-14 08:13:17,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 08:13:17,209 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 08:13:17,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 08:13:17,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:17,216 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:17,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 08:13:17,219 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:17,225 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 08:13:17,233 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,233 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,233 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,233 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:17,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:17,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:17,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:17,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,238 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:17,238 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:17,242 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:13:17,244 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/recovered.edits] 2023-07-14 08:13:17,248 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/recovered.edits] 2023-07-14 08:13:17,251 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf/b78982e4b8404ad49ed7b722758389d7 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/cf/b78982e4b8404ad49ed7b722758389d7 2023-07-14 08:13:17,258 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116/recovered.edits/9.seqid 2023-07-14 08:13:17,258 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf/0a32ab48691e4967a2af8cea39ad30be to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/cf/0a32ab48691e4967a2af8cea39ad30be 2023-07-14 08:13:17,259 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/9e7e531ca6b725380702766321c97116 2023-07-14 08:13:17,265 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b/recovered.edits/9.seqid 2023-07-14 08:13:17,268 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemState/b56797d5a39282ab1ea88d2f8731f50b 2023-07-14 08:13:17,269 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 08:13:17,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:17,279 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 08:13:17,282 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 08:13:17,284 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:17,284 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 08:13:17,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322397284"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:17,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322397284"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:17,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:13:17,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9e7e531ca6b725380702766321c97116, NAME => 'testtb-testExportFileSystemState,,1689322378157.9e7e531ca6b725380702766321c97116.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b56797d5a39282ab1ea88d2f8731f50b, NAME => 'testtb-testExportFileSystemState,1,1689322378157.b56797d5a39282ab1ea88d2f8731f50b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:13:17,301 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 08:13:17,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322397301"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:17,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 08:13:17,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:17,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 99 msec 2023-07-14 08:13:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 08:13:17,340 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 08:13:17,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 08:13:17,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:17,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 08:13:17,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 08:13:17,406 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=762 (was 751) Potentially hanging thread: hconnection-0x291cea62-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:57504 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:39589 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x291cea62-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1515920612_1 at /127.0.0.1:57488 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:43264 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:34488 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:39889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x291cea62-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1515920612_1 at /127.0.0.1:34472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=627 (was 699), ProcessCount=189 (was 189), AvailableMemoryMB=1022 (was 987) - AvailableMemoryMB LEAK? - 2023-07-14 08:13:17,406 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-14 08:13:17,444 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=627, ProcessCount=189, AvailableMemoryMB=1021 2023-07-14 08:13:17,444 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-14 08:13:17,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:13:17,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:13:17,453 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:13:17,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:13:17,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 08:13:17,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:17,470 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:17,472 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:17,473 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 empty. 2023-07-14 08:13:17,473 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f empty. 2023-07-14 08:13:17,474 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:17,474 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:17,475 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 08:13:17,535 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 08:13:17,537 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9b73953c08d9f49c32b934d37e79356, NAME => 'testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:13:17,537 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a1b04aa42c738810dafd0cbaf520e25f, NAME => 'testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:13:17,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:17,570 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:17,571 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a1b04aa42c738810dafd0cbaf520e25f, disabling compactions & flushes 2023-07-14 08:13:17,571 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:17,571 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:17,571 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. after waiting 0 ms 2023-07-14 08:13:17,571 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:17,571 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:17,571 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a1b04aa42c738810dafd0cbaf520e25f: 2023-07-14 08:13:17,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:17,972 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:17,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing f9b73953c08d9f49c32b934d37e79356, disabling compactions & flushes 2023-07-14 08:13:17,973 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:17,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:17,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. after waiting 0 ms 2023-07-14 08:13:17,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:17,973 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:17,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for f9b73953c08d9f49c32b934d37e79356: 2023-07-14 08:13:17,977 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:13:17,979 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322397978"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322397978"}]},"ts":"1689322397978"} 2023-07-14 08:13:17,979 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322397978"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322397978"}]},"ts":"1689322397978"} 2023-07-14 08:13:17,982 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:13:17,983 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:13:17,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322397983"}]},"ts":"1689322397983"} 2023-07-14 08:13:17,985 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 08:13:17,989 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:13:17,990 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:13:17,991 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:13:17,991 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:13:17,991 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:13:17,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, ASSIGN}] 2023-07-14 08:13:17,994 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, ASSIGN 2023-07-14 08:13:17,994 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, ASSIGN 2023-07-14 08:13:17,996 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43891,1689322343628; forceNewPlan=false, retain=false 2023-07-14 08:13:17,996 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39739,1689322343570; forceNewPlan=false, retain=false 2023-07-14 08:13:18,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:18,146 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:13:18,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f9b73953c08d9f49c32b934d37e79356, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,150 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a1b04aa42c738810dafd0cbaf520e25f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,150 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322398150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322398150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322398150"}]},"ts":"1689322398150"} 2023-07-14 08:13:18,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322398150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322398150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322398150"}]},"ts":"1689322398150"} 2023-07-14 08:13:18,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure f9b73953c08d9f49c32b934d37e79356, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:13:18,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure a1b04aa42c738810dafd0cbaf520e25f, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:13:18,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:18,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9b73953c08d9f49c32b934d37e79356, NAME => 'testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. service=AccessControlService 2023-07-14 08:13:18,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:18,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1b04aa42c738810dafd0cbaf520e25f, NAME => 'testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. service=AccessControlService 2023-07-14 08:13:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:13:18,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:18,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,315 INFO [StoreOpener-f9b73953c08d9f49c32b934d37e79356-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,315 INFO [StoreOpener-a1b04aa42c738810dafd0cbaf520e25f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,316 DEBUG [StoreOpener-f9b73953c08d9f49c32b934d37e79356-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf 2023-07-14 08:13:18,316 DEBUG [StoreOpener-f9b73953c08d9f49c32b934d37e79356-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf 2023-07-14 08:13:18,316 DEBUG [StoreOpener-a1b04aa42c738810dafd0cbaf520e25f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf 2023-07-14 08:13:18,316 DEBUG [StoreOpener-a1b04aa42c738810dafd0cbaf520e25f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf 2023-07-14 08:13:18,317 INFO [StoreOpener-f9b73953c08d9f49c32b934d37e79356-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9b73953c08d9f49c32b934d37e79356 columnFamilyName cf 2023-07-14 08:13:18,317 INFO [StoreOpener-a1b04aa42c738810dafd0cbaf520e25f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1b04aa42c738810dafd0cbaf520e25f columnFamilyName cf 2023-07-14 08:13:18,317 INFO [StoreOpener-f9b73953c08d9f49c32b934d37e79356-1] regionserver.HStore(310): Store=f9b73953c08d9f49c32b934d37e79356/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:13:18,317 INFO [StoreOpener-a1b04aa42c738810dafd0cbaf520e25f-1] regionserver.HStore(310): Store=a1b04aa42c738810dafd0cbaf520e25f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:13:18,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:13:18,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:13:18,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:13:18,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:13:18,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a1b04aa42c738810dafd0cbaf520e25f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59620959, jitterRate=-0.11157847940921783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:13:18,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a1b04aa42c738810dafd0cbaf520e25f: 2023-07-14 08:13:18,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f9b73953c08d9f49c32b934d37e79356; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70151316, jitterRate=0.04533606767654419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:13:18,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f9b73953c08d9f49c32b934d37e79356: 2023-07-14 08:13:18,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356., pid=45, masterSystemTime=1689322398304 2023-07-14 08:13:18,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f., pid=46, masterSystemTime=1689322398308 2023-07-14 08:13:18,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:18,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:18,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a1b04aa42c738810dafd0cbaf520e25f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:18,329 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322398329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322398329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322398329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322398329"}]},"ts":"1689322398329"} 2023-07-14 08:13:18,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:18,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f9b73953c08d9f49c32b934d37e79356, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,330 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322398329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322398329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322398329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322398329"}]},"ts":"1689322398329"} 2023-07-14 08:13:18,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-14 08:13:18,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure a1b04aa42c738810dafd0cbaf520e25f, server=jenkins-hbase9.apache.org,39739,1689322343570 in 178 msec 2023-07-14 08:13:18,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-14 08:13:18,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure f9b73953c08d9f49c32b934d37e79356, server=jenkins-hbase9.apache.org,43891,1689322343628 in 181 msec 2023-07-14 08:13:18,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, ASSIGN in 344 msec 2023-07-14 08:13:18,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-14 08:13:18,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, ASSIGN in 349 msec 2023-07-14 08:13:18,349 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:13:18,350 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322398350"}]},"ts":"1689322398350"} 2023-07-14 08:13:18,351 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 08:13:18,354 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:13:18,354 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 08:13:18,356 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 08:13:18,359 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:18,359 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:18,359 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:18,359 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:18,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:18,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:18,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:18,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:18,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 913 msec 2023-07-14 08:13:18,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:18,563 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 08:13:18,564 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-14 08:13:18,564 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:18,568 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-14 08:13:18,569 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:18,569 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-14 08:13:18,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:18,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322398572 (current time:1689322398572). 2023-07-14 08:13:18,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:13:18,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x3e892b03 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:18,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46bb1619, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:18,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:18,594 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:18,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e892b03 to 127.0.0.1:54201 2023-07-14 08:13:18,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:18,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x50ffb76e to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:18,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27594f41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:18,609 DEBUG [hconnection-0x39cc8e6d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:18,612 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:18,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:18,620 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:18,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50ffb76e to 127.0.0.1:54201 2023-07-14 08:13:18,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:18,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 08:13:18,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:13:18,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:18,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:18,626 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:18,627 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689322998627 2023-07-14 08:13:18,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 08:13:18,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:18,629 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:13:18,629 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:13:18,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:18,632 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:18,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-14 08:13:18,641 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:18,641 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689322998641 2023-07-14 08:13:18,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,654 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 08:13:18,654 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:18,656 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 08:13:18,656 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 08:13:18,657 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,657 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,658 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:18,658 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:18,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:18,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:18,658 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,658 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:18,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:18,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:18,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:18,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:18,658 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,658 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,659 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,659 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:13:18,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:18,661 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:18,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,661 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:18,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,661 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:18,661 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:18,661 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:18,663 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:18,664 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:18,661 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:18,664 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:18,664 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:18,664 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:18,669 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:18,669 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:18,669 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:18,669 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:18,671 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,673 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:18,673 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:18,673 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:18,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:18,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357824c1[Count = 1] remaining members to acquire global barrier 2023-07-14 08:13:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:18,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:18,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357824c1[Count = 0] remaining members to acquire global barrier 2023-07-14 08:13:18,682 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 08:13:18,682 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,684 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:18,684 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:18,684 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,684 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:18,684 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:18,685 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:18,685 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:18,685 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:18,685 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:18,685 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,685 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. started... 2023-07-14 08:13:18,685 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. started... 2023-07-14 08:13:18,685 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:13:18,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,687 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9b73953c08d9f49c32b934d37e79356: 2023-07-14 08:13:18,688 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1b04aa42c738810dafd0cbaf520e25f: 2023-07-14 08:13:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,688 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:18,688 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,688 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,688 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:18,689 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:18,689 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:18,690 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:13:18,690 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:13:18,690 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:13:18,696 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:18,696 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:18,696 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:18,729 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:18,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:18,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:18,731 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:13:18,759 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. completed. 2023-07-14 08:13:18,759 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:18,760 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:18,760 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:18,760 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,760 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:18,760 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:13:18,762 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:18,762 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,762 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:18,762 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:13:18,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 08:13:18,774 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. completed. 2023-07-14 08:13:18,775 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:18,775 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:18,775 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:18,775 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,775 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:18,775 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:13:18,776 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:18,776 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,776 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:18,777 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:13:18,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 08:13:18,783 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 08:13:18,783 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:13:18,783 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:13:18,783 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,783 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,786 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:18,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:18,787 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:18,788 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,798 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:18,799 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,800 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,813 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,814 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:18,814 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:18,814 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:18,814 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:18,814 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:18,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:18,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,814 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:18,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:18,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:18,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:18,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:18,814 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,816 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,816 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:18,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:18,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:18,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:18,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:18,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:18,817 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:18,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:18,931 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:18,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:18,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:18,932 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:13:19,233 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:19,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:19,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:19,234 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:13:19,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 08:13:19,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:19,304 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:19,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689322398627Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689322398814 (+187 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689322398814Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689322398826 (+12 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689322398841 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689322399303 (+462 ms) 2023-07-14 08:13:19,306 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:19,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 678 msec 2023-07-14 08:13:19,734 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:19,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:19,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:13:19,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43891] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:13:19,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39739] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:13:19,774 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 08:13:19,774 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:19,776 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:19,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:19,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322399794 (current time:1689322399794). 2023-07-14 08:13:19,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:13:19,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x2f1af565 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:19,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e86941, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:19,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:19,826 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:19,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f1af565 to 127.0.0.1:54201 2023-07-14 08:13:19,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:19,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x5da70908 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:19,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@256e6e04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:19,845 DEBUG [hconnection-0x749da989-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:19,849 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:19,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:19,855 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5da70908 to 127.0.0.1:54201 2023-07-14 08:13:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 08:13:19,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:13:19,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:19,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:19,862 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:19,867 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689322999867 2023-07-14 08:13:19,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 08:13:19,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:19,869 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:13:19,869 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:13:19,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:19,873 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:19,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 14 msec 2023-07-14 08:13:19,877 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:19,878 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689322999878 2023-07-14 08:13:19,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 08:13:19,900 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 08:13:19,901 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:19,902 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 08:13:19,902 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 08:13:19,903 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,903 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,904 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:19,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:19,905 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:19,905 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:19,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:19,905 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:19,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,906 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,906 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 08:13:19,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:19,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:13:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 08:13:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:19,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 08:13:19,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:19,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 08:13:19,914 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:19,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 08:13:19,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 08:13:19,914 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:19,914 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:19,914 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:19,917 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:19,917 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:19,917 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:19,917 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:19,919 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:19,918 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:19,919 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:19,919 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:19,920 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:19,921 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,921 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:19,921 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,922 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e46c8d[Count = 1] remaining members to acquire global barrier 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:19,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:19,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:19,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:19,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e46c8d[Count = 0] remaining members to acquire global barrier 2023-07-14 08:13:19,928 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 08:13:19,928 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,935 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,935 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,936 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:19,936 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,936 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:19,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,938 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:19,938 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:19,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:19,938 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:19,938 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:19,939 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. started... 2023-07-14 08:13:19,939 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:19,939 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:13:19,939 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f9b73953c08d9f49c32b934d37e79356 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 08:13:19,939 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:19,939 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:19,939 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:19,939 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:19,939 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:19,939 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:13:19,940 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:19,941 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:19,941 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:19,942 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. started... 2023-07-14 08:13:19,942 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1b04aa42c738810dafd0cbaf520e25f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 08:13:19,969 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:19,970 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/.tmp/cf/b9fc9c8db3994c6f91cd457aa5aab6a9 2023-07-14 08:13:19,970 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/.tmp/cf/ffd40ffc9cd5438a92a17de649993216 2023-07-14 08:13:19,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:19,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:19,971 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:13:19,979 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/.tmp/cf/b9fc9c8db3994c6f91cd457aa5aab6a9 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf/b9fc9c8db3994c6f91cd457aa5aab6a9 2023-07-14 08:13:19,980 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/.tmp/cf/ffd40ffc9cd5438a92a17de649993216 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf/ffd40ffc9cd5438a92a17de649993216 2023-07-14 08:13:19,985 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf/b9fc9c8db3994c6f91cd457aa5aab6a9, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 08:13:19,985 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf/ffd40ffc9cd5438a92a17de649993216, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 08:13:19,986 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a1b04aa42c738810dafd0cbaf520e25f in 44ms, sequenceid=6, compaction requested=false 2023-07-14 08:13:19,986 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 08:13:19,986 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for f9b73953c08d9f49c32b934d37e79356 in 47ms, sequenceid=6, compaction requested=false 2023-07-14 08:13:19,986 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 08:13:19,988 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1b04aa42c738810dafd0cbaf520e25f: 2023-07-14 08:13:19,988 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9b73953c08d9f49c32b934d37e79356: 2023-07-14 08:13:19,988 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:19,988 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:19,988 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:19,988 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:19,989 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf/ffd40ffc9cd5438a92a17de649993216] hfiles 2023-07-14 08:13:19,989 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf/b9fc9c8db3994c6f91cd457aa5aab6a9] hfiles 2023-07-14 08:13:19,989 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf/ffd40ffc9cd5438a92a17de649993216 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:19,989 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf/b9fc9c8db3994c6f91cd457aa5aab6a9 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:20,029 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. completed. 2023-07-14 08:13:20,029 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:13:20,029 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:20,029 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:20,029 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,029 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:20,029 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:13:20,030 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. completed. 2023-07-14 08:13:20,030 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:13:20,030 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:20,030 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:20,031 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,031 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:20,031 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:13:20,031 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,031 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,031 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,032 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:20,034 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,034 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:20,035 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,035 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:20,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:13:20,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 08:13:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:13:20,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 08:13:20,047 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 08:13:20,048 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:13:20,048 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:13:20,048 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 08:13:20,048 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:13:20,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,051 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,051 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,052 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,053 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,053 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,056 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:20,056 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,057 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,064 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,064 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,064 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,064 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,064 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,064 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:13:20,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 08:13:20,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 08:13:20,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,065 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:13:20,068 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,069 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,171 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:20,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:20,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:20,173 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:13:20,474 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:20,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:20,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:20,475 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:13:20,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 08:13:20,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,542 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:20,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689322399867Consolidate snapshot: snaptb0-testConsecutiveExports at 1689322400066 (+199 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689322400066Writing data manifest for snaptb0-testConsecutiveExports at 1689322400080 (+14 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689322400502 (+422 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689322400541 (+39 ms) 2023-07-14 08:13:20,545 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:20,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 677 msec 2023-07-14 08:13:20,975 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:20,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:20,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:13:20,977 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977 2023-07-14 08:13:20,978 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:13:21,010 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:13:21,010 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6e036b84, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,010 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 08:13:21,023 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,052 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,053 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,053 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,053 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:22,221 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-6097648904855335244.jar 2023-07-14 08:13:22,221 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,222 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,312 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-8061662138977350570.jar 2023-07-14 08:13:22,312 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,313 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,314 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,314 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,315 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,315 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:22,316 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:13:22,317 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:13:22,317 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:13:22,318 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:13:22,318 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:13:22,319 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:13:22,320 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:13:22,320 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:13:22,321 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:13:22,322 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:13:22,323 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:22,323 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:22,324 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:22,325 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:22,325 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:22,326 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:22,327 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:22,687 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:13:23,525 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:13:23,529 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 08:13:23,531 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 08:13:23,617 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:23,617 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:24,053 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:29,875 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:32,280 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:36,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:38,835 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:13:38,836 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:13:38,855 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 08:13:38,856 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:13:38,857 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:13:38,857 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:13:38,868 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:13:38,868 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:13:38,868 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@658c0b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:13:38,868 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:13:38,869 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:13:38,870 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:13:38,916 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:13:38,919 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6c5331d0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:38,927 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 08:13:38,975 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:39,084 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:39,084 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:39,085 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:39,086 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,292 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-2644976013025546264.jar 2023-07-14 08:13:40,292 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,293 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,413 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-8585195577165848829.jar 2023-07-14 08:13:40,414 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,415 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,415 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,416 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,416 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,417 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,417 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:13:40,418 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:13:40,418 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:13:40,419 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:13:40,420 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:13:40,421 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:13:40,421 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:13:40,422 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:13:40,422 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:13:40,424 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:13:40,425 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:40,426 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:40,428 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:40,429 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:42,374 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:13:42,383 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 08:13:42,396 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 08:13:43,054 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:43,054 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:43,058 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:43,476 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0004_000001 (auth:SIMPLE) 2023-07-14 08:13:51,755 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0004_000001 (auth:SIMPLE) 2023-07-14 08:13:54,353 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0004_000001 (auth:SIMPLE) 2023-07-14 08:14:01,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0004_000001 (auth:SIMPLE) 2023-07-14 08:14:02,774 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:14:02,774 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:14:02,792 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 08:14:02,792 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:14:02,793 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:14:02,793 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:14:02,796 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:14:02,796 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:14:02,797 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@658c0b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:14:02,797 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:14:02,797 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/local-export-1689322400977/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:14:02,827 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 08:14:02,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 08:14:02,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:02,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:02,836 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322442836"}]},"ts":"1689322442836"} 2023-07-14 08:14:02,850 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 08:14:02,860 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 08:14:02,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, UNASSIGN}] 2023-07-14 08:14:02,862 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, UNASSIGN 2023-07-14 08:14:02,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, UNASSIGN 2023-07-14 08:14:02,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a1b04aa42c738810dafd0cbaf520e25f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:02,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322442865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322442865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322442865"}]},"ts":"1689322442865"} 2023-07-14 08:14:02,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure a1b04aa42c738810dafd0cbaf520e25f, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:14:02,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f9b73953c08d9f49c32b934d37e79356, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:02,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322442869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322442869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322442869"}]},"ts":"1689322442869"} 2023-07-14 08:14:02,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure f9b73953c08d9f49c32b934d37e79356, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:14:02,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:03,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:14:03,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a1b04aa42c738810dafd0cbaf520e25f, disabling compactions & flushes 2023-07-14 08:14:03,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:14:03,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:14:03,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. after waiting 0 ms 2023-07-14 08:14:03,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:14:03,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:14:03,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f9b73953c08d9f49c32b934d37e79356, disabling compactions & flushes 2023-07-14 08:14:03,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:14:03,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:14:03,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. after waiting 0 ms 2023-07-14 08:14:03,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:14:03,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:03,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:03,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f. 2023-07-14 08:14:03,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a1b04aa42c738810dafd0cbaf520e25f: 2023-07-14 08:14:03,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:14:03,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a1b04aa42c738810dafd0cbaf520e25f, regionState=CLOSED 2023-07-14 08:14:03,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322443101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322443101"}]},"ts":"1689322443101"} 2023-07-14 08:14:03,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:03,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:03,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356. 2023-07-14 08:14:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f9b73953c08d9f49c32b934d37e79356: 2023-07-14 08:14:03,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-14 08:14:03,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure a1b04aa42c738810dafd0cbaf520e25f, server=jenkins-hbase9.apache.org,39739,1689322343570 in 240 msec 2023-07-14 08:14:03,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:14:03,117 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f9b73953c08d9f49c32b934d37e79356, regionState=CLOSED 2023-07-14 08:14:03,118 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322443117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322443117"}]},"ts":"1689322443117"} 2023-07-14 08:14:03,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a1b04aa42c738810dafd0cbaf520e25f, UNASSIGN in 255 msec 2023-07-14 08:14:03,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-14 08:14:03,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure f9b73953c08d9f49c32b934d37e79356, server=jenkins-hbase9.apache.org,43891,1689322343628 in 248 msec 2023-07-14 08:14:03,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-14 08:14:03,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9b73953c08d9f49c32b934d37e79356, UNASSIGN in 261 msec 2023-07-14 08:14:03,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322443125"}]},"ts":"1689322443125"} 2023-07-14 08:14:03,127 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 08:14:03,130 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 08:14:03,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:03,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 307 msec 2023-07-14 08:14:03,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:03,440 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 08:14:03,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 08:14:03,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:03,449 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:03,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 08:14:03,452 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 08:14:03,453 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:03,458 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,458 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,458 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,459 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:03,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:03,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:03,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-14 08:14:03,464 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:03,464 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:03,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 08:14:03,467 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:14:03,472 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:14:03,473 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/recovered.edits] 2023-07-14 08:14:03,477 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/recovered.edits] 2023-07-14 08:14:03,487 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf/ffd40ffc9cd5438a92a17de649993216 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/cf/ffd40ffc9cd5438a92a17de649993216 2023-07-14 08:14:03,491 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f/recovered.edits/9.seqid 2023-07-14 08:14:03,492 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/a1b04aa42c738810dafd0cbaf520e25f 2023-07-14 08:14:03,501 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf/b9fc9c8db3994c6f91cd457aa5aab6a9 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/cf/b9fc9c8db3994c6f91cd457aa5aab6a9 2023-07-14 08:14:03,506 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356/recovered.edits/9.seqid 2023-07-14 08:14:03,506 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testConsecutiveExports/f9b73953c08d9f49c32b934d37e79356 2023-07-14 08:14:03,507 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 08:14:03,510 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:03,535 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 08:14:03,538 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 08:14:03,546 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:03,546 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 08:14:03,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322443546"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:03,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322443546"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:03,564 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:14:03,564 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f9b73953c08d9f49c32b934d37e79356, NAME => 'testtb-testConsecutiveExports,,1689322397447.f9b73953c08d9f49c32b934d37e79356.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a1b04aa42c738810dafd0cbaf520e25f, NAME => 'testtb-testConsecutiveExports,1,1689322397447.a1b04aa42c738810dafd0cbaf520e25f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:14:03,564 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 08:14:03,565 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322443564"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:03,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 08:14:03,576 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 08:14:03,581 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:03,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 140 msec 2023-07-14 08:14:03,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 08:14:03,769 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 08:14:03,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 08:14:03,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 08:14:03,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 08:14:03,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 08:14:03,902 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=746 (was 762), OpenFileDescriptor=895 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=952 (was 627) - SystemLoadAverage LEAK? -, ProcessCount=195 (was 189) - ProcessCount LEAK? -, AvailableMemoryMB=854 (was 1021) 2023-07-14 08:14:03,903 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-14 08:14:03,946 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=952, ProcessCount=194, AvailableMemoryMB=851 2023-07-14 08:14:03,947 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-14 08:14:03,951 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:14:03,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:03,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:03,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 08:14:03,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:03,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:04,010 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,013 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,014 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 empty. 2023-07-14 08:14:04,015 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,018 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 empty. 2023-07-14 08:14:04,021 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,021 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 08:14:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:04,139 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:04,176 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => b6d13ecef3c4ab93dd012b4593108145, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:04,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2dd2361b57b4fd340dedd836fee7f520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:04,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:04,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:04,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing b6d13ecef3c4ab93dd012b4593108145, disabling compactions & flushes 2023-07-14 08:14:04,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. after waiting 0 ms 2023-07-14 08:14:04,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for b6d13ecef3c4ab93dd012b4593108145: 2023-07-14 08:14:04,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:04,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2dd2361b57b4fd340dedd836fee7f520, disabling compactions & flushes 2023-07-14 08:14:04,342 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. after waiting 0 ms 2023-07-14 08:14:04,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,342 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2dd2361b57b4fd340dedd836fee7f520: 2023-07-14 08:14:04,346 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:04,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322444347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322444347"}]},"ts":"1689322444347"} 2023-07-14 08:14:04,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322444347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322444347"}]},"ts":"1689322444347"} 2023-07-14 08:14:04,355 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:04,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:04,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322444356"}]},"ts":"1689322444356"} 2023-07-14 08:14:04,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 08:14:04,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:04,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:04,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:04,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:04,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:04,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, ASSIGN}] 2023-07-14 08:14:04,368 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, ASSIGN 2023-07-14 08:14:04,368 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, ASSIGN 2023-07-14 08:14:04,377 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39739,1689322343570; forceNewPlan=false, retain=false 2023-07-14 08:14:04,377 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:14:04,527 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:04,530 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b6d13ecef3c4ab93dd012b4593108145, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:04,530 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2dd2361b57b4fd340dedd836fee7f520, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:04,531 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322444530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322444530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322444530"}]},"ts":"1689322444530"} 2023-07-14 08:14:04,531 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322444530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322444530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322444530"}]},"ts":"1689322444530"} 2023-07-14 08:14:04,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure b6d13ecef3c4ab93dd012b4593108145, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:04,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 2dd2361b57b4fd340dedd836fee7f520, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:14:04,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:04,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6d13ecef3c4ab93dd012b4593108145, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:14:04,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. service=AccessControlService 2023-07-14 08:14:04,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:04,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2dd2361b57b4fd340dedd836fee7f520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:14:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. service=AccessControlService 2023-07-14 08:14:04,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:04,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,701 INFO [StoreOpener-2dd2361b57b4fd340dedd836fee7f520-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,705 INFO [StoreOpener-b6d13ecef3c4ab93dd012b4593108145-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,705 DEBUG [StoreOpener-2dd2361b57b4fd340dedd836fee7f520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf 2023-07-14 08:14:04,706 DEBUG [StoreOpener-2dd2361b57b4fd340dedd836fee7f520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf 2023-07-14 08:14:04,707 DEBUG [StoreOpener-b6d13ecef3c4ab93dd012b4593108145-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf 2023-07-14 08:14:04,707 DEBUG [StoreOpener-b6d13ecef3c4ab93dd012b4593108145-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf 2023-07-14 08:14:04,707 INFO [StoreOpener-2dd2361b57b4fd340dedd836fee7f520-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dd2361b57b4fd340dedd836fee7f520 columnFamilyName cf 2023-07-14 08:14:04,708 INFO [StoreOpener-2dd2361b57b4fd340dedd836fee7f520-1] regionserver.HStore(310): Store=2dd2361b57b4fd340dedd836fee7f520/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:04,707 INFO [StoreOpener-b6d13ecef3c4ab93dd012b4593108145-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6d13ecef3c4ab93dd012b4593108145 columnFamilyName cf 2023-07-14 08:14:04,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,710 INFO [StoreOpener-b6d13ecef3c4ab93dd012b4593108145-1] regionserver.HStore(310): Store=b6d13ecef3c4ab93dd012b4593108145/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:04,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:04,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:04,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2dd2361b57b4fd340dedd836fee7f520; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63994000, jitterRate=-0.046415090560913086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:04,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2dd2361b57b4fd340dedd836fee7f520: 2023-07-14 08:14:04,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520., pid=61, masterSystemTime=1689322444691 2023-07-14 08:14:04,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:04,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:04,725 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2dd2361b57b4fd340dedd836fee7f520, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:04,726 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322444725"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322444725"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322444725"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322444725"}]},"ts":"1689322444725"} 2023-07-14 08:14:04,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:04,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b6d13ecef3c4ab93dd012b4593108145; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62194686, jitterRate=-0.07322695851325989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:04,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b6d13ecef3c4ab93dd012b4593108145: 2023-07-14 08:14:04,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145., pid=60, masterSystemTime=1689322444687 2023-07-14 08:14:04,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:04,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-14 08:14:04,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 2dd2361b57b4fd340dedd836fee7f520, server=jenkins-hbase9.apache.org,39739,1689322343570 in 192 msec 2023-07-14 08:14:04,735 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b6d13ecef3c4ab93dd012b4593108145, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:04,735 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322444735"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322444735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322444735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322444735"}]},"ts":"1689322444735"} 2023-07-14 08:14:04,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, ASSIGN in 371 msec 2023-07-14 08:14:04,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-14 08:14:04,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure b6d13ecef3c4ab93dd012b4593108145, server=jenkins-hbase9.apache.org,44465,1689322343497 in 204 msec 2023-07-14 08:14:04,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-14 08:14:04,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, ASSIGN in 375 msec 2023-07-14 08:14:04,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:04,743 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322444743"}]},"ts":"1689322444743"} 2023-07-14 08:14:04,745 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 08:14:04,754 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:04,754 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 08:14:04,757 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 08:14:04,759 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:04,761 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:04,762 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:04,762 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:04,762 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:04,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:04,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:04,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:04,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 810 msec 2023-07-14 08:14:05,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:05,077 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 08:14:05,077 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-14 08:14:05,077 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:05,081 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-14 08:14:05,081 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:05,081 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-14 08:14:05,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:05,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322445094 (current time:1689322445094). 2023-07-14 08:14:05,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:05,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x29451a0b to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:05,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30777efe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:05,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:05,135 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:05,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29451a0b to 127.0.0.1:54201 2023-07-14 08:14:05,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:05,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x4261f219 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:05,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a65c794, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:05,148 DEBUG [hconnection-0x53fac771-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:05,149 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:05,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:05,157 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:05,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4261f219 to 127.0.0.1:54201 2023-07-14 08:14:05,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:05,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 08:14:05,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:05,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:05,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:05,165 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:05,166 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689323045166 2023-07-14 08:14:05,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:05,169 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:05,169 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:05,171 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:05,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:05,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-14 08:14:05,175 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:05,177 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689323045177 2023-07-14 08:14:05,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,234 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 08:14:05,234 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:05,237 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 08:14:05,237 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 08:14:05,238 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,238 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,239 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:05,239 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:05,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:05,239 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,239 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:05,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:05,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:05,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:05,240 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,240 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,241 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,241 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:05,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 08:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,241 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:05,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 08:14:05,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 08:14:05,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,245 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:05,242 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:05,245 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:05,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:05,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,250 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:05,250 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:05,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,260 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:05,260 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:05,260 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:05,260 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:05,261 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:05,260 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:05,261 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:05,261 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:05,262 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:05,264 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,265 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,265 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,265 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,265 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,265 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,265 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:05,266 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,266 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:05,266 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,266 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,269 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:05,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:05,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:05,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d94a9f6[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:05,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:05,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:05,270 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:05,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:05,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d94a9f6[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:05,273 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 08:14:05,273 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,275 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,275 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:05,275 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,276 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:05,276 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:05,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,276 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,276 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:05,277 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,277 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:05,277 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:05,278 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:05,278 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:05,278 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. started... 2023-07-14 08:14:05,280 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd2361b57b4fd340dedd836fee7f520: 2023-07-14 08:14:05,280 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,280 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:05,280 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:05,282 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,282 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:05,283 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:05,283 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:05,283 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:05,283 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. started... 2023-07-14 08:14:05,285 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6d13ecef3c4ab93dd012b4593108145: 2023-07-14 08:14:05,285 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,285 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:05,285 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:05,286 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:05,286 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:05,286 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:05,347 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. completed. 2023-07-14 08:14:05,347 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:05,349 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,349 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:05,349 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:05,349 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,353 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. completed. 2023-07-14 08:14:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,353 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:05,353 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:05,354 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:05,354 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,354 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:05,354 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:05,357 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,357 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,357 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:05,357 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:14:05,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 08:14:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:14:05,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 08:14:05,367 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 08:14:05,367 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:05,367 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:05,368 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,368 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:05,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:05,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:05,370 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,369 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,370 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:05,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,377 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:05,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:05,379 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,380 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,380 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:05,384 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:05,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:05,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:05,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,385 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,385 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:05,385 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:05,385 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:05,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:05,385 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:05,385 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:05,388 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,388 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:05,388 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:05,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:05,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:05,388 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:05,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:05,388 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,471 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:05,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:05,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:05,472 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:05,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 08:14:05,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,624 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689322445167Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322445385 (+218 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322445385Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322445402 (+17 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322445431 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689322445623 (+192 ms) 2023-07-14 08:14:05,627 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:05,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 459 msec 2023-07-14 08:14:05,772 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:05,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:05,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:05,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44465] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:05,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39739] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:05,832 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:05,832 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:05,832 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:05,892 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:05,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322445892 (current time:1689322445892). 2023-07-14 08:14:05,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:05,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x41c13256 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:05,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e4eeac1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:05,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:05,999 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:06,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41c13256 to 127.0.0.1:54201 2023-07-14 08:14:06,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:06,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x0309a68e to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:06,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b92673b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:06,090 DEBUG [hconnection-0x1253946a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:06,096 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:06,126 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:06,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0309a68e to 127.0.0.1:54201 2023-07-14 08:14:06,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:06,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 08:14:06,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:06,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:06,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:06,153 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:06,158 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689323046158 2023-07-14 08:14:06,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:06,158 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:06,159 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:06,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:06,165 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:06,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 30 msec 2023-07-14 08:14:06,171 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:06,172 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689323046172 2023-07-14 08:14:06,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,225 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 08:14:06,225 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:06,238 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 08:14:06,239 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 08:14:06,239 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,239 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,259 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:06,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:06,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:06,261 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:06,291 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:06,291 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:06,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:06,291 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:06,291 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:06,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:06,292 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,292 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,294 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,294 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:06,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 08:14:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:06,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 08:14:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 08:14:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:06,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,301 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:06,301 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:06,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,309 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:06,309 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:06,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,318 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:06,319 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:06,318 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:06,319 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:06,319 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:06,319 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:06,319 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:06,319 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:06,321 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:06,321 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:06,321 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:06,361 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,361 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,399 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:06,399 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:06,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:06,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2874ef[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:06,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:06,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:06,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:06,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:06,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:06,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2874ef[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:06,408 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 08:14:06,408 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,410 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,410 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,411 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:06,411 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:06,411 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:06,411 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:06,411 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,411 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:06,412 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:06,412 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:06,412 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,412 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:06,412 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. started... 2023-07-14 08:14:06,412 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b6d13ecef3c4ab93dd012b4593108145 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-14 08:14:06,414 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:06,414 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:06,414 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:06,414 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,414 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:06,425 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:06,426 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:06,436 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:06,436 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. started... 2023-07-14 08:14:06,437 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2dd2361b57b4fd340dedd836fee7f520 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-14 08:14:06,461 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:06,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:06,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:06,462 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:06,488 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/.tmp/cf/201edb7ec659493490632a1e31ef873e 2023-07-14 08:14:06,502 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/.tmp/cf/201edb7ec659493490632a1e31ef873e as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf/201edb7ec659493490632a1e31ef873e 2023-07-14 08:14:06,512 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf/201edb7ec659493490632a1e31ef873e, entries=2, sequenceid=6, filesize=5.0 K 2023-07-14 08:14:06,517 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/.tmp/cf/a88c4b4861e648c0adcd0dcac62cd3a1 2023-07-14 08:14:06,532 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b6d13ecef3c4ab93dd012b4593108145 in 120ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:06,532 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 08:14:06,533 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6d13ecef3c4ab93dd012b4593108145: 2023-07-14 08:14:06,533 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,534 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:06,534 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf/201edb7ec659493490632a1e31ef873e] hfiles 2023-07-14 08:14:06,534 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf/201edb7ec659493490632a1e31ef873e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,539 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/.tmp/cf/a88c4b4861e648c0adcd0dcac62cd3a1 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf/a88c4b4861e648c0adcd0dcac62cd3a1 2023-07-14 08:14:06,551 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf/a88c4b4861e648c0adcd0dcac62cd3a1, entries=48, sequenceid=6, filesize=8.1 K 2023-07-14 08:14:06,557 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 2dd2361b57b4fd340dedd836fee7f520 in 120ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:06,583 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd2361b57b4fd340dedd836fee7f520: 2023-07-14 08:14:06,583 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,583 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:06,583 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf/a88c4b4861e648c0adcd0dcac62cd3a1] hfiles 2023-07-14 08:14:06,583 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf/a88c4b4861e648c0adcd0dcac62cd3a1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,616 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. completed. 2023-07-14 08:14:06,616 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:06,616 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:06,616 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:06,616 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,617 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:06,617 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:06,620 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:06,620 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:06,620 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,620 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:06,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:06,653 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. completed. 2023-07-14 08:14:06,653 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:06,653 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:06,654 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:06,654 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:06,654 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:06,654 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:06,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,656 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,656 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:06,656 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:06,656 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:06,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:06,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:14:06,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 08:14:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:06,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:06,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:06,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:14:06,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 08:14:06,666 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 08:14:06,666 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:06,666 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:06,666 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,666 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:06,675 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,675 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,675 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,676 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:06,675 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:06,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,675 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:06,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:06,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:06,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:06,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,679 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,679 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,679 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,681 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,682 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:06,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:06,682 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:06,684 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:06,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:06,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:06,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:06,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:06,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:06,699 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:06,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:06,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:06,699 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:06,698 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:06,698 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:06,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:06,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:06,699 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:06,701 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:06,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:06,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:06,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:06,702 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-14 08:14:06,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:06,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:06,763 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:06,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:06,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:06,764 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:14:06,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 08:14:06,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,838 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:06,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689322446158Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689322446698 (+540 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689322446699 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689322446715 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689322446756 (+41 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689322446836 (+80 ms) 2023-07-14 08:14:06,841 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:06,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 680 msec 2023-07-14 08:14:07,264 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:07,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:07,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:07,318 DEBUG [Listener at jenkins-hbase9.apache.org/36457] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:14:07,324 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:14:07,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39739] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 08:14:07,327 DEBUG [Listener at jenkins-hbase9.apache.org/36457] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:14:07,337 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:14:07,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43891] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 08:14:07,340 DEBUG [Listener at jenkins-hbase9.apache.org/36457] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:14:07,345 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:14:07,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44465] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 08:14:07,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:14:07,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:07,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:07,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 08:14:07,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:07,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:07,378 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,382 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 empty. 2023-07-14 08:14:07,382 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,383 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,383 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 empty. 2023-07-14 08:14:07,384 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,384 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 08:14:07,447 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:07,449 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => e9d7b2a5b53cc1e9abf17f418efc87b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:07,449 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => ecc29c90706f421490e996763d411134, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:07,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:07,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:07,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing e9d7b2a5b53cc1e9abf17f418efc87b0, disabling compactions & flushes 2023-07-14 08:14:07,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. after waiting 0 ms 2023-07-14 08:14:07,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for e9d7b2a5b53cc1e9abf17f418efc87b0: 2023-07-14 08:14:07,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:07,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing ecc29c90706f421490e996763d411134, disabling compactions & flushes 2023-07-14 08:14:07,560 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. after waiting 0 ms 2023-07-14 08:14:07,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,560 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for ecc29c90706f421490e996763d411134: 2023-07-14 08:14:07,566 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:07,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322447567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322447567"}]},"ts":"1689322447567"} 2023-07-14 08:14:07,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322447567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322447567"}]},"ts":"1689322447567"} 2023-07-14 08:14:07,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:07,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:07,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322447578"}]},"ts":"1689322447578"} 2023-07-14 08:14:07,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 08:14:07,584 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:07,586 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:07,586 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:07,586 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:07,586 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:07,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, ASSIGN}] 2023-07-14 08:14:07,592 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, ASSIGN 2023-07-14 08:14:07,592 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, ASSIGN 2023-07-14 08:14:07,600 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43891,1689322343628; forceNewPlan=false, retain=false 2023-07-14 08:14:07,601 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:14:07,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:07,734 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0004_000001 (auth:SIMPLE) 2023-07-14 08:14:07,752 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:07,755 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ecc29c90706f421490e996763d411134, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:07,755 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e9d7b2a5b53cc1e9abf17f418efc87b0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:07,755 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322447755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322447755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322447755"}]},"ts":"1689322447755"} 2023-07-14 08:14:07,756 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322447755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322447755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322447755"}]},"ts":"1689322447755"} 2023-07-14 08:14:07,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ecc29c90706f421490e996763d411134, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:07,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure e9d7b2a5b53cc1e9abf17f418efc87b0, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:14:07,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecc29c90706f421490e996763d411134, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 08:14:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. service=AccessControlService 2023-07-14 08:14:07,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9d7b2a5b53cc1e9abf17f418efc87b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 08:14:07,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. service=AccessControlService 2023-07-14 08:14:07,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:07,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:07,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,934 INFO [StoreOpener-ecc29c90706f421490e996763d411134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,937 DEBUG [StoreOpener-ecc29c90706f421490e996763d411134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf 2023-07-14 08:14:07,938 DEBUG [StoreOpener-ecc29c90706f421490e996763d411134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf 2023-07-14 08:14:07,938 INFO [StoreOpener-ecc29c90706f421490e996763d411134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecc29c90706f421490e996763d411134 columnFamilyName cf 2023-07-14 08:14:07,939 INFO [StoreOpener-e9d7b2a5b53cc1e9abf17f418efc87b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,939 INFO [StoreOpener-ecc29c90706f421490e996763d411134-1] regionserver.HStore(310): Store=ecc29c90706f421490e996763d411134/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:07,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,940 DEBUG [StoreOpener-e9d7b2a5b53cc1e9abf17f418efc87b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf 2023-07-14 08:14:07,940 DEBUG [StoreOpener-e9d7b2a5b53cc1e9abf17f418efc87b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf 2023-07-14 08:14:07,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,941 INFO [StoreOpener-e9d7b2a5b53cc1e9abf17f418efc87b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9d7b2a5b53cc1e9abf17f418efc87b0 columnFamilyName cf 2023-07-14 08:14:07,941 INFO [StoreOpener-e9d7b2a5b53cc1e9abf17f418efc87b0-1] regionserver.HStore(310): Store=e9d7b2a5b53cc1e9abf17f418efc87b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:07,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:07,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ecc29c90706f421490e996763d411134 2023-07-14 08:14:07,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:07,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:07,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e9d7b2a5b53cc1e9abf17f418efc87b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72695885, jitterRate=0.08325310051441193}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:07,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e9d7b2a5b53cc1e9abf17f418efc87b0: 2023-07-14 08:14:07,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ecc29c90706f421490e996763d411134; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72824799, jitterRate=0.0851740688085556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:07,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ecc29c90706f421490e996763d411134: 2023-07-14 08:14:07,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0., pid=70, masterSystemTime=1689322447914 2023-07-14 08:14:07,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134., pid=69, masterSystemTime=1689322447914 2023-07-14 08:14:07,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:07,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:07,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e9d7b2a5b53cc1e9abf17f418efc87b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:07,974 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322447974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322447974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322447974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322447974"}]},"ts":"1689322447974"} 2023-07-14 08:14:07,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:07,975 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ecc29c90706f421490e996763d411134, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:07,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322447975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322447975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322447975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322447975"}]},"ts":"1689322447975"} 2023-07-14 08:14:07,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-14 08:14:07,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure e9d7b2a5b53cc1e9abf17f418efc87b0, server=jenkins-hbase9.apache.org,43891,1689322343628 in 217 msec 2023-07-14 08:14:07,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-14 08:14:07,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ecc29c90706f421490e996763d411134, server=jenkins-hbase9.apache.org,44465,1689322343497 in 220 msec 2023-07-14 08:14:07,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, ASSIGN in 396 msec 2023-07-14 08:14:07,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 08:14:07,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, ASSIGN in 396 msec 2023-07-14 08:14:07,989 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:07,989 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322447989"}]},"ts":"1689322447989"} 2023-07-14 08:14:07,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 08:14:07,996 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:07,996 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 08:14:08,000 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 08:14:08,002 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,002 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,002 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,002 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 656 msec 2023-07-14 08:14:08,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:08,474 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 08:14:08,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions ecc29c90706f421490e996763d411134, e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:08,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ecc29c90706f421490e996763d411134, e9d7b2a5b53cc1e9abf17f418efc87b0], force=true 2023-07-14 08:14:08,540 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ecc29c90706f421490e996763d411134, e9d7b2a5b53cc1e9abf17f418efc87b0], force=true 2023-07-14 08:14:08,540 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ecc29c90706f421490e996763d411134, e9d7b2a5b53cc1e9abf17f418efc87b0], force=true 2023-07-14 08:14:08,540 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ecc29c90706f421490e996763d411134, e9d7b2a5b53cc1e9abf17f418efc87b0], force=true 2023-07-14 08:14:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:08,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, UNASSIGN}] 2023-07-14 08:14:08,590 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, UNASSIGN 2023-07-14 08:14:08,591 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, UNASSIGN 2023-07-14 08:14:08,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ecc29c90706f421490e996763d411134, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:08,594 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322448594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322448594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322448594"}]},"ts":"1689322448594"} 2023-07-14 08:14:08,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e9d7b2a5b53cc1e9abf17f418efc87b0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:08,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322448595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322448595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322448595"}]},"ts":"1689322448595"} 2023-07-14 08:14:08,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure ecc29c90706f421490e996763d411134, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:08,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure e9d7b2a5b53cc1e9abf17f418efc87b0, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:14:08,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:08,737 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:14:08,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:08,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e9d7b2a5b53cc1e9abf17f418efc87b0, disabling compactions & flushes 2023-07-14 08:14:08,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:08,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:08,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. after waiting 0 ms 2023-07-14 08:14:08,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:08,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing e9d7b2a5b53cc1e9abf17f418efc87b0 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 08:14:08,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ecc29c90706f421490e996763d411134 2023-07-14 08:14:08,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ecc29c90706f421490e996763d411134, disabling compactions & flushes 2023-07-14 08:14:08,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:08,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:08,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. after waiting 0 ms 2023-07-14 08:14:08,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:08,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ecc29c90706f421490e996763d411134 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 08:14:08,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:08,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/.tmp/cf/b2337027f4e747e6b1783235382ce7d6 2023-07-14 08:14:08,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/.tmp/cf/b2337027f4e747e6b1783235382ce7d6 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf/b2337027f4e747e6b1783235382ce7d6 2023-07-14 08:14:08,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf/b2337027f4e747e6b1783235382ce7d6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 08:14:08,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e9d7b2a5b53cc1e9abf17f418efc87b0 in 150ms, sequenceid=5, compaction requested=false 2023-07-14 08:14:08,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 08:14:08,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/.tmp/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0 2023-07-14 08:14:08,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/.tmp/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0 2023-07-14 08:14:08,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 08:14:08,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ecc29c90706f421490e996763d411134 in 189ms, sequenceid=5, compaction requested=false 2023-07-14 08:14:09,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 08:14:09,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:09,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134. 2023-07-14 08:14:09,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ecc29c90706f421490e996763d411134: 2023-07-14 08:14:09,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ecc29c90706f421490e996763d411134 2023-07-14 08:14:09,045 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ecc29c90706f421490e996763d411134, regionState=CLOSED 2023-07-14 08:14:09,046 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322449045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322449045"}]},"ts":"1689322449045"} 2023-07-14 08:14:09,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-14 08:14:09,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure ecc29c90706f421490e996763d411134, server=jenkins-hbase9.apache.org,44465,1689322343497 in 450 msec 2023-07-14 08:14:09,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ecc29c90706f421490e996763d411134, UNASSIGN in 482 msec 2023-07-14 08:14:09,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 08:14:09,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:09,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0. 2023-07-14 08:14:09,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e9d7b2a5b53cc1e9abf17f418efc87b0: 2023-07-14 08:14:09,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:09,072 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e9d7b2a5b53cc1e9abf17f418efc87b0, regionState=CLOSED 2023-07-14 08:14:09,073 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322449072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322449072"}]},"ts":"1689322449072"} 2023-07-14 08:14:09,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-14 08:14:09,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure e9d7b2a5b53cc1e9abf17f418efc87b0, server=jenkins-hbase9.apache.org,43891,1689322343628 in 475 msec 2023-07-14 08:14:09,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-14 08:14:09,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9d7b2a5b53cc1e9abf17f418efc87b0, UNASSIGN in 505 msec 2023-07-14 08:14:09,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:09,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:09,783 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 08:14:09,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447349.ecc29c90706f421490e996763d411134.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:09,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322447349.e9d7b2a5b53cc1e9abf17f418efc87b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:09,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:09,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, ASSIGN}] 2023-07-14 08:14:09,862 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, ASSIGN 2023-07-14 08:14:09,863 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:14:10,013 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 08:14:10,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=04cd85ddce714f1975f6e063cdb8b0f5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,016 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322450016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322450016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322450016"}]},"ts":"1689322450016"} 2023-07-14 08:14:10,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 04cd85ddce714f1975f6e063cdb8b0f5, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:10,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:10,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04cd85ddce714f1975f6e063cdb8b0f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:14:10,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. service=AccessControlService 2023-07-14 08:14:10,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:10,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:10,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/.regioninfo 2023-07-14 08:14:10,230 INFO [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,232 DEBUG [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf 2023-07-14 08:14:10,232 DEBUG [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf 2023-07-14 08:14:10,233 INFO [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04cd85ddce714f1975f6e063cdb8b0f5 columnFamilyName cf 2023-07-14 08:14:10,280 DEBUG [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] regionserver.HStore(539): loaded hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0.ecc29c90706f421490e996763d411134->hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0-top 2023-07-14 08:14:10,301 DEBUG [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] regionserver.HStore(539): loaded hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/b2337027f4e747e6b1783235382ce7d6.e9d7b2a5b53cc1e9abf17f418efc87b0->hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf/b2337027f4e747e6b1783235382ce7d6-top 2023-07-14 08:14:10,301 INFO [StoreOpener-04cd85ddce714f1975f6e063cdb8b0f5-1] regionserver.HStore(310): Store=04cd85ddce714f1975f6e063cdb8b0f5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:10,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:10,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 04cd85ddce714f1975f6e063cdb8b0f5; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68480529, jitterRate=0.020439401268959045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:10,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 04cd85ddce714f1975f6e063cdb8b0f5: 2023-07-14 08:14:10,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5., pid=77, masterSystemTime=1689322450170 2023-07-14 08:14:10,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.,because compaction is disabled. 2023-07-14 08:14:10,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:10,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:10,319 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=04cd85ddce714f1975f6e063cdb8b0f5, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,320 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322450319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322450319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322450319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322450319"}]},"ts":"1689322450319"} 2023-07-14 08:14:10,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 08:14:10,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 04cd85ddce714f1975f6e063cdb8b0f5, server=jenkins-hbase9.apache.org,44465,1689322343497 in 304 msec 2023-07-14 08:14:10,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 08:14:10,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, ASSIGN in 463 msec 2023-07-14 08:14:10,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ecc29c90706f421490e996763d411134, e9d7b2a5b53cc1e9abf17f418efc87b0], force=true in 1.8010 sec 2023-07-14 08:14:10,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:10,662 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 08:14:10,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 08:14:10,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322450664 (current time:1689322450664). 2023-07-14 08:14:10,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:10,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x013c165c to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:10,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ba40e94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:10,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:10,715 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:10,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x013c165c to 127.0.0.1:54201 2023-07-14 08:14:10,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:10,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x27f10006 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:10,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@469e7c52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:10,757 DEBUG [hconnection-0x5dd51abb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:10,761 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:10,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:10,769 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:10,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27f10006 to 127.0.0.1:54201 2023-07-14 08:14:10,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:10,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 08:14:10,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:10,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 08:14:10,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 08:14:10,781 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 08:14:10,782 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689323050782 2023-07-14 08:14:10,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 08:14:10,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,787 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:10,787 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:10,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 08:14:10,796 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 08:14:10,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 17 msec 2023-07-14 08:14:10,800 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 08:14:10,802 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689323050801 2023-07-14 08:14:10,888 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:10,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:10,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:10,896 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:10,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,902 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 08:14:10,902 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,903 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 08:14:10,903 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 08:14:10,904 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,904 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,906 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:10,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:10,907 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:10,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:10,907 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,908 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:10,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 08:14:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 08:14:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 08:14:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,909 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:10,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 08:14:10,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:10,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:10,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 08:14:10,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 08:14:10,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,918 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 08:14:10,918 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,928 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 08:14:10,928 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 08:14:10,928 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 08:14:10,928 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 08:14:10,928 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,930 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 08:14:10,930 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 08:14:10,930 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 08:14:10,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,935 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 08:14:10,935 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,937 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 08:14:10,937 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 08:14:10,937 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 08:14:10,937 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,938 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,938 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:10,940 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,941 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,941 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,941 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,941 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:10,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:10,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:10,941 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,941 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:10,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:10,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:10,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:10,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:10,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 08:14:10,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48821187[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:10,945 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 08:14:10,945 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 08:14:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 08:14:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 08:14:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:10,947 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:10,947 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. started... 2023-07-14 08:14:10,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,949 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 08:14:10,949 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04cd85ddce714f1975f6e063cdb8b0f5: 2023-07-14 08:14:10,949 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:10,950 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:10,950 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,950 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:10,949 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 08:14:10,950 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:10,950 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0.ecc29c90706f421490e996763d411134->hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0-top, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/b2337027f4e747e6b1783235382ce7d6.e9d7b2a5b53cc1e9abf17f418efc87b0->hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf/b2337027f4e747e6b1783235382ce7d6-top] hfiles 2023-07-14 08:14:10,950 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0.ecc29c90706f421490e996763d411134 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,951 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 08:14:10,951 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:10,951 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 08:14:10,953 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/b2337027f4e747e6b1783235382ce7d6.e9d7b2a5b53cc1e9abf17f418efc87b0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:10,967 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 08:14:10,967 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:10,967 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 08:14:11,027 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. completed. 2023-07-14 08:14:11,027 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:11,027 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:11,027 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:11,027 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,027 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 08:14:11,027 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:11,035 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,035 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 08:14:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:11,035 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:11,035 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 08:14:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:14:11,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 08:14:11,044 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 08:14:11,044 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:11,044 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:11,044 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,044 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:11,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:11,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,053 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,054 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:11,054 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:11,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,060 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,060 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,060 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:11,065 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:11,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:11,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:11,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:11,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:11,066 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,066 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,070 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:11,070 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,070 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:11,071 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:11,070 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,071 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,096 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:11,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:11,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:11,099 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:11,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 08:14:11,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,391 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689322450783Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322451071 (+288 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322451071Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322451107 (+36 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322451192 (+85 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689322451389 (+197 ms) 2023-07-14 08:14:11,394 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 08:14:11,399 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:11,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 607 msec 2023-07-14 08:14:11,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:11,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:11,406 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406 2023-07-14 08:14:11,406 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45081, tgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406, rawTgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:14:11,445 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:14:11,445 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-759420921_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,445 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 08:14:11,482 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:11,641 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:11,642 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:11,642 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:11,643 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,801 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-2413757994611599149.jar 2023-07-14 08:14:12,802 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,802 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,901 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-644216789255448766.jar 2023-07-14 08:14:12,904 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,905 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,906 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,906 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,907 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,907 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:12,908 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:14:12,909 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:14:12,910 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:14:12,910 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:14:12,911 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:14:12,912 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:14:12,912 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:14:12,913 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:14:12,913 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:14:12,915 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:14:12,918 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:12,918 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:12,919 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:12,920 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:12,920 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:12,921 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:12,922 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:14,543 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:14:15,698 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:14:15,716 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 08:14:15,719 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 08:14:15,889 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:15,889 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:16,196 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:25,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:27,585 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:35,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:37,188 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:14:37,199 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:14:37,249 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,249 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:14:37,250 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:14:37,250 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,252 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 08:14:37,252 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 08:14:37,252 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,252 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 08:14:37,253 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322451406/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 08:14:37,275 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,282 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322477282"}]},"ts":"1689322477282"} 2023-07-14 08:14:37,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 08:14:37,289 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 08:14:37,291 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 08:14:37,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, UNASSIGN}] 2023-07-14 08:14:37,296 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, UNASSIGN 2023-07-14 08:14:37,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=04cd85ddce714f1975f6e063cdb8b0f5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:37,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322477306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322477306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322477306"}]},"ts":"1689322477306"} 2023-07-14 08:14:37,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 04cd85ddce714f1975f6e063cdb8b0f5, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:37,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 08:14:37,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:37,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 04cd85ddce714f1975f6e063cdb8b0f5, disabling compactions & flushes 2023-07-14 08:14:37,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:37,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:37,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. after waiting 0 ms 2023-07-14 08:14:37,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:37,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 08:14:37,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:37,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5. 2023-07-14 08:14:37,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 04cd85ddce714f1975f6e063cdb8b0f5: 2023-07-14 08:14:37,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:37,551 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=04cd85ddce714f1975f6e063cdb8b0f5, regionState=CLOSED 2023-07-14 08:14:37,551 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322477551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322477551"}]},"ts":"1689322477551"} 2023-07-14 08:14:37,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 08:14:37,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 04cd85ddce714f1975f6e063cdb8b0f5, server=jenkins-hbase9.apache.org,44465,1689322343497 in 242 msec 2023-07-14 08:14:37,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 08:14:37,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04cd85ddce714f1975f6e063cdb8b0f5, UNASSIGN in 263 msec 2023-07-14 08:14:37,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322477560"}]},"ts":"1689322477560"} 2023-07-14 08:14:37,561 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 08:14:37,567 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 08:14:37,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 292 msec 2023-07-14 08:14:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 08:14:37,591 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 08:14:37,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,596 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,597 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,603 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,606 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,606 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,607 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 08:14:37,607 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 08:14:37,610 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,610 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 08:14:37,611 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:37,611 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,611 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,611 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:37,611 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:37,611 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:37,611 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:37,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 08:14:37,612 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:37,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 08:14:37,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:37,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:37,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:37,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:37,619 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:37,621 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 2023-07-14 08:14:37,642 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:37,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/recovered.edits] 2023-07-14 08:14:37,656 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/recovered.edits] 2023-07-14 08:14:37,657 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0.ecc29c90706f421490e996763d411134 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0.ecc29c90706f421490e996763d411134 2023-07-14 08:14:37,657 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/recovered.edits] 2023-07-14 08:14:37,660 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/b2337027f4e747e6b1783235382ce7d6.e9d7b2a5b53cc1e9abf17f418efc87b0 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/cf/b2337027f4e747e6b1783235382ce7d6.e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:37,664 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/cf/55b1ce9271cd4aa1aeb322c56ed6fbb0 2023-07-14 08:14:37,667 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/recovered.edits/12.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5/recovered.edits/12.seqid 2023-07-14 08:14:37,667 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf/b2337027f4e747e6b1783235382ce7d6 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/cf/b2337027f4e747e6b1783235382ce7d6 2023-07-14 08:14:37,668 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04cd85ddce714f1975f6e063cdb8b0f5 2023-07-14 08:14:37,671 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/recovered.edits/8.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134/recovered.edits/8.seqid 2023-07-14 08:14:37,672 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ecc29c90706f421490e996763d411134 2023-07-14 08:14:37,672 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/recovered.edits/8.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0/recovered.edits/8.seqid 2023-07-14 08:14:37,673 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9d7b2a5b53cc1e9abf17f418efc87b0 2023-07-14 08:14:37,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 08:14:37,678 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,689 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 08:14:37,696 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 08:14:37,697 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,697 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 08:14:37,698 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322477697"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:37,708 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 08:14:37,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04cd85ddce714f1975f6e063cdb8b0f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322447350.04cd85ddce714f1975f6e063cdb8b0f5.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 08:14:37,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 08:14:37,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322477708"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:37,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 08:14:37,721 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 08:14:37,725 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:37,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 133 msec 2023-07-14 08:14:37,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 08:14:37,915 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 08:14:37,916 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:37,916 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:37,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:37,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:37,926 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322477925"}]},"ts":"1689322477925"} 2023-07-14 08:14:37,932 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 08:14:37,934 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 08:14:37,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, UNASSIGN}] 2023-07-14 08:14:37,940 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, UNASSIGN 2023-07-14 08:14:37,942 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, UNASSIGN 2023-07-14 08:14:37,944 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2dd2361b57b4fd340dedd836fee7f520, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:37,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322477944"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322477944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322477944"}]},"ts":"1689322477944"} 2023-07-14 08:14:37,944 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b6d13ecef3c4ab93dd012b4593108145, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:37,945 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322477944"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322477944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322477944"}]},"ts":"1689322477944"} 2023-07-14 08:14:37,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure b6d13ecef3c4ab93dd012b4593108145, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:37,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2dd2361b57b4fd340dedd836fee7f520, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:14:38,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:38,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:38,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b6d13ecef3c4ab93dd012b4593108145, disabling compactions & flushes 2023-07-14 08:14:38,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:38,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:38,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. after waiting 0 ms 2023-07-14 08:14:38,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:38,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:38,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2dd2361b57b4fd340dedd836fee7f520, disabling compactions & flushes 2023-07-14 08:14:38,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:38,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. after waiting 0 ms 2023-07-14 08:14:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:38,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:38,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:38,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145. 2023-07-14 08:14:38,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b6d13ecef3c4ab93dd012b4593108145: 2023-07-14 08:14:38,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:38,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:38,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520. 2023-07-14 08:14:38,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2dd2361b57b4fd340dedd836fee7f520: 2023-07-14 08:14:38,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:38,222 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b6d13ecef3c4ab93dd012b4593108145, regionState=CLOSED 2023-07-14 08:14:38,222 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322478222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322478222"}]},"ts":"1689322478222"} 2023-07-14 08:14:38,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:38,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2dd2361b57b4fd340dedd836fee7f520, regionState=CLOSED 2023-07-14 08:14:38,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322478224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322478224"}]},"ts":"1689322478224"} 2023-07-14 08:14:38,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:38,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-14 08:14:38,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure b6d13ecef3c4ab93dd012b4593108145, server=jenkins-hbase9.apache.org,44465,1689322343497 in 267 msec 2023-07-14 08:14:38,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-14 08:14:38,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2dd2361b57b4fd340dedd836fee7f520, server=jenkins-hbase9.apache.org,39739,1689322343570 in 264 msec 2023-07-14 08:14:38,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6d13ecef3c4ab93dd012b4593108145, UNASSIGN in 289 msec 2023-07-14 08:14:38,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-14 08:14:38,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2dd2361b57b4fd340dedd836fee7f520, UNASSIGN in 290 msec 2023-07-14 08:14:38,252 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322478252"}]},"ts":"1689322478252"} 2023-07-14 08:14:38,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 08:14:38,257 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 08:14:38,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 341 msec 2023-07-14 08:14:38,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:38,528 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 08:14:38,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,533 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,534 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,536 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,551 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,551 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,551 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,551 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 08:14:38,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 08:14:38,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 08:14:38,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,553 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:38,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 08:14:38,557 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:38,565 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/recovered.edits] 2023-07-14 08:14:38,565 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:38,575 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/recovered.edits] 2023-07-14 08:14:38,580 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf/201edb7ec659493490632a1e31ef873e to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/cf/201edb7ec659493490632a1e31ef873e 2023-07-14 08:14:38,597 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145/recovered.edits/9.seqid 2023-07-14 08:14:38,597 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6d13ecef3c4ab93dd012b4593108145 2023-07-14 08:14:38,622 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf/a88c4b4861e648c0adcd0dcac62cd3a1 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/cf/a88c4b4861e648c0adcd0dcac62cd3a1 2023-07-14 08:14:38,631 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520/recovered.edits/9.seqid 2023-07-14 08:14:38,633 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2dd2361b57b4fd340dedd836fee7f520 2023-07-14 08:14:38,633 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 08:14:38,637 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 08:14:38,661 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 08:14:38,665 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 08:14:38,668 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,668 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 08:14:38,668 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322478668"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:38,668 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322478668"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:38,670 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:14:38,670 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b6d13ecef3c4ab93dd012b4593108145, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689322443951.b6d13ecef3c4ab93dd012b4593108145.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2dd2361b57b4fd340dedd836fee7f520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322443951.2dd2361b57b4fd340dedd836fee7f520.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:14:38,670 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 08:14:38,670 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322478670"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:38,674 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 08:14:38,676 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 148 msec 2023-07-14 08:14:38,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 08:14:38,859 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 08:14:38,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 08:14:38,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,896 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 08:14:38,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:38,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 08:14:38,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:38,962 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=755 (was 746) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1834619066_1 at /127.0.0.1:46578 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:33525 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:44440 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:36457 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x291cea62-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:46590 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:36852 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1220 (was 952) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 194), AvailableMemoryMB=823 (was 851) 2023-07-14 08:14:38,963 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-14 08:14:39,005 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=755, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=1220, ProcessCount=192, AvailableMemoryMB=803 2023-07-14 08:14:39,005 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-14 08:14:39,008 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:14:39,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:39,019 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:39,020 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 08:14:39,023 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:39,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:39,028 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,034 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 empty. 2023-07-14 08:14:39,034 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,035 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,036 DEBUG [HFileArchiver-25] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc empty. 2023-07-14 08:14:39,037 DEBUG [HFileArchiver-25] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,037 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 08:14:39,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:39,132 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:39,135 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b426f7dd47af26240c9121e61bf7dd07, NAME => 'testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:39,144 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 021fb7e89744bfbfbbb1e8dcdd40f2cc, NAME => 'testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:39,258 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:39,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b426f7dd47af26240c9121e61bf7dd07, disabling compactions & flushes 2023-07-14 08:14:39,259 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. after waiting 0 ms 2023-07-14 08:14:39,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,259 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b426f7dd47af26240c9121e61bf7dd07: 2023-07-14 08:14:39,260 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:39,260 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 021fb7e89744bfbfbbb1e8dcdd40f2cc, disabling compactions & flushes 2023-07-14 08:14:39,260 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,260 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,260 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. after waiting 0 ms 2023-07-14 08:14:39,260 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,260 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,260 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 021fb7e89744bfbfbbb1e8dcdd40f2cc: 2023-07-14 08:14:39,263 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:39,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322479264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322479264"}]},"ts":"1689322479264"} 2023-07-14 08:14:39,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322479264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322479264"}]},"ts":"1689322479264"} 2023-07-14 08:14:39,269 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:39,270 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:39,271 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322479271"}]},"ts":"1689322479271"} 2023-07-14 08:14:39,272 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 08:14:39,276 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:39,277 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:39,277 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:39,277 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:39,278 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:39,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, ASSIGN}] 2023-07-14 08:14:39,281 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, ASSIGN 2023-07-14 08:14:39,282 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39739,1689322343570; forceNewPlan=false, retain=false 2023-07-14 08:14:39,283 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, ASSIGN 2023-07-14 08:14:39,284 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43891,1689322343628; forceNewPlan=false, retain=false 2023-07-14 08:14:39,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:39,433 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:39,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=021fb7e89744bfbfbbb1e8dcdd40f2cc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:39,440 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322479439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322479439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322479439"}]},"ts":"1689322479439"} 2023-07-14 08:14:39,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b426f7dd47af26240c9121e61bf7dd07, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:39,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322479440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322479440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322479440"}]},"ts":"1689322479440"} 2023-07-14 08:14:39,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 021fb7e89744bfbfbbb1e8dcdd40f2cc, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:14:39,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure b426f7dd47af26240c9121e61bf7dd07, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:14:39,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b426f7dd47af26240c9121e61bf7dd07, NAME => 'testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:14:39,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. service=AccessControlService 2023-07-14 08:14:39,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,625 INFO [StoreOpener-b426f7dd47af26240c9121e61bf7dd07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,628 DEBUG [StoreOpener-b426f7dd47af26240c9121e61bf7dd07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf 2023-07-14 08:14:39,628 DEBUG [StoreOpener-b426f7dd47af26240c9121e61bf7dd07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf 2023-07-14 08:14:39,629 INFO [StoreOpener-b426f7dd47af26240c9121e61bf7dd07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b426f7dd47af26240c9121e61bf7dd07 columnFamilyName cf 2023-07-14 08:14:39,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:39,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 021fb7e89744bfbfbbb1e8dcdd40f2cc, NAME => 'testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:14:39,629 INFO [StoreOpener-b426f7dd47af26240c9121e61bf7dd07-1] regionserver.HStore(310): Store=b426f7dd47af26240c9121e61bf7dd07/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:39,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. service=AccessControlService 2023-07-14 08:14:39,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,633 INFO [StoreOpener-021fb7e89744bfbfbbb1e8dcdd40f2cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:39,639 DEBUG [StoreOpener-021fb7e89744bfbfbbb1e8dcdd40f2cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf 2023-07-14 08:14:39,639 DEBUG [StoreOpener-021fb7e89744bfbfbbb1e8dcdd40f2cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf 2023-07-14 08:14:39,641 INFO [StoreOpener-021fb7e89744bfbfbbb1e8dcdd40f2cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 021fb7e89744bfbfbbb1e8dcdd40f2cc columnFamilyName cf 2023-07-14 08:14:39,641 INFO [StoreOpener-021fb7e89744bfbfbbb1e8dcdd40f2cc-1] regionserver.HStore(310): Store=021fb7e89744bfbfbbb1e8dcdd40f2cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b426f7dd47af26240c9121e61bf7dd07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62479942, jitterRate=-0.06897631287574768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b426f7dd47af26240c9121e61bf7dd07: 2023-07-14 08:14:39,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07., pid=94, masterSystemTime=1689322479597 2023-07-14 08:14:39,649 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b426f7dd47af26240c9121e61bf7dd07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:39,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:39,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322479649"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322479649"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322479649"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322479649"}]},"ts":"1689322479649"} 2023-07-14 08:14:39,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-14 08:14:39,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure b426f7dd47af26240c9121e61bf7dd07, server=jenkins-hbase9.apache.org,39739,1689322343570 in 207 msec 2023-07-14 08:14:39,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:39,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, ASSIGN in 375 msec 2023-07-14 08:14:39,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:39,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 021fb7e89744bfbfbbb1e8dcdd40f2cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67363892, jitterRate=0.00380021333694458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:39,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 021fb7e89744bfbfbbb1e8dcdd40f2cc: 2023-07-14 08:14:39,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc., pid=93, masterSystemTime=1689322479595 2023-07-14 08:14:39,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:39,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=021fb7e89744bfbfbbb1e8dcdd40f2cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:39,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322479660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322479660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322479660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322479660"}]},"ts":"1689322479660"} 2023-07-14 08:14:39,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-14 08:14:39,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 021fb7e89744bfbfbbb1e8dcdd40f2cc, server=jenkins-hbase9.apache.org,43891,1689322343628 in 219 msec 2023-07-14 08:14:39,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-14 08:14:39,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, ASSIGN in 389 msec 2023-07-14 08:14:39,669 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:39,669 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322479669"}]},"ts":"1689322479669"} 2023-07-14 08:14:39,674 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 08:14:39,682 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:39,682 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 08:14:39,684 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:14:39,687 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:39,687 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:39,687 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:39,687 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:39,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:39,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:39,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:39,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:39,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 683 msec 2023-07-14 08:14:40,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:40,131 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 08:14:40,131 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 08:14:40,131 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:40,139 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 08:14:40,139 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:40,139 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-14 08:14:40,153 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:40,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322480154 (current time:1689322480154). 2023-07-14 08:14:40,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:40,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x6be77fd3 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:40,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@156ccc28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:40,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:40,202 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6be77fd3 to 127.0.0.1:54201 2023-07-14 08:14:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x54c4bb9c to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d4f30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:40,314 DEBUG [hconnection-0x7773de15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:40,318 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:40,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:40,327 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:40,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54c4bb9c to 127.0.0.1:54201 2023-07-14 08:14:40,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:40,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:14:40,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:40,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:40,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:40,337 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:40,338 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689323080338 2023-07-14 08:14:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:40,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:40,340 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:40,340 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:40,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:40,343 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:40,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-14 08:14:40,349 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:40,350 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689323080350 2023-07-14 08:14:40,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,393 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 08:14:40,393 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:40,395 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 08:14:40,395 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:14:40,435 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,435 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,441 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:40,442 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:40,442 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:40,442 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:40,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:40,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:40,442 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:40,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:40,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:40,443 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,443 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,443 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,445 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,446 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,446 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:40,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,447 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:40,447 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:40,446 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:40,449 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:40,450 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:40,450 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:40,450 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 08:14:40,450 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:40,450 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:40,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,454 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,454 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,454 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:40,455 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,456 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,456 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:40,463 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,463 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:40,464 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,464 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d279c1e[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:40,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:40,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d279c1e[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:40,471 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:14:40,471 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,474 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:40,474 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,475 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:40,475 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:40,475 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:40,475 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,475 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:40,477 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:40,477 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:40,477 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:40,479 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:40,479 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. started... 2023-07-14 08:14:40,481 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b426f7dd47af26240c9121e61bf7dd07: 2023-07-14 08:14:40,482 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,482 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:40,482 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:40,493 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:40,493 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:40,493 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:40,493 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. started... 2023-07-14 08:14:40,495 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 021fb7e89744bfbfbbb1e8dcdd40f2cc: 2023-07-14 08:14:40,496 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,496 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:40,496 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:40,555 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. completed. 2023-07-14 08:14:40,555 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:40,555 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:40,555 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:40,555 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,555 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:40,555 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:40,557 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:40,557 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:40,557 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:40,558 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:40,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:14:40,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:14:40,603 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. completed. 2023-07-14 08:14:40,603 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:40,603 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:40,603 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:40,603 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,603 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:40,603 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:40,605 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,605 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:40,605 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:40,605 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:40,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:40,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:40,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:40,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:14:40,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:14:40,614 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 08:14:40,614 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:40,614 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:40,614 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,614 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:40,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:40,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:40,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:40,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:40,620 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,621 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:40,629 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:40,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,638 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,639 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,641 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,643 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:40,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:40,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:40,645 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:40,645 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:40,645 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:40,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:40,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,645 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:40,645 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:40,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:40,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:40,645 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:40,645 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:40,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:40,646 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:40,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:40,649 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,649 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,650 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:40,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:40,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:40,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 08:14:40,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,831 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:40,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689322480338Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689322480646 (+308 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689322480646Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689322480667 (+21 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689322480743 (+76 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689322480830 (+87 ms) 2023-07-14 08:14:40,835 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:40,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 497 msec 2023-07-14 08:14:40,945 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:40,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:40,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:40,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39739] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:40,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43891] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:40,982 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:40,982 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:40,982 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:41,016 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322481016 (current time:1689322481016). 2023-07-14 08:14:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x444b7fa7 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:41,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2da1924d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:41,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:41,050 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:41,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x444b7fa7 to 127.0.0.1:54201 2023-07-14 08:14:41,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:41,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x16b665d8 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:41,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@99f86ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:41,158 DEBUG [hconnection-0x280d4e6a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:41,160 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:41,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:41,168 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16b665d8 to 127.0.0.1:54201 2023-07-14 08:14:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:14:41,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:41,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:41,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:41,176 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:41,177 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689323081177 2023-07-14 08:14:41,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:41,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:41,179 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:41,180 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:41,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:41,181 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:41,183 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-14 08:14:41,184 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:41,185 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689323081185 2023-07-14 08:14:41,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,217 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 08:14:41,217 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:41,219 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 08:14:41,219 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:14:41,280 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:41,280 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,280 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,281 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,281 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:41,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:41,282 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,282 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,282 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:41,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,282 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,282 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:41,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 08:14:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 08:14:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:41,284 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:41,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 08:14:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:41,287 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:41,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:41,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,288 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:41,288 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:41,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,302 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:41,302 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:41,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:41,321 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:41,323 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,323 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:41,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:41,337 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:41,337 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:41,337 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:41,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:41,338 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,338 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,338 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:41,338 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,338 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:41,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:41,339 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,339 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,340 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,340 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:41,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:41,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:41,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5145355[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:41,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:41,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:41,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:41,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:41,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5145355[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:41,346 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:14:41,346 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:41,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,353 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:41,353 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:41,353 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:41,353 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:41,355 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:41,355 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:41,355 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:41,358 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:41,359 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:41,359 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:41,360 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,359 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:41,360 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:41,360 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. started... 2023-07-14 08:14:41,360 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:41,360 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,360 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:41,360 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b426f7dd47af26240c9121e61bf7dd07 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 08:14:41,361 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. started... 2023-07-14 08:14:41,361 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 021fb7e89744bfbfbbb1e8dcdd40f2cc 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 08:14:41,376 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:41,458 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/.tmp/cf/1616060851e744078b51be4ce2d81b55 2023-07-14 08:14:41,466 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/.tmp/cf/1616060851e744078b51be4ce2d81b55 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf/1616060851e744078b51be4ce2d81b55 2023-07-14 08:14:41,469 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/.tmp/cf/891d4ec0c63f418aa76cf4351ab94c69 2023-07-14 08:14:41,475 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf/1616060851e744078b51be4ce2d81b55, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 08:14:41,478 INFO [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b426f7dd47af26240c9121e61bf7dd07 in 118ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:41,478 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 08:14:41,478 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/.tmp/cf/891d4ec0c63f418aa76cf4351ab94c69 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf/891d4ec0c63f418aa76cf4351ab94c69 2023-07-14 08:14:41,478 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b426f7dd47af26240c9121e61bf7dd07: 2023-07-14 08:14:41,478 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,480 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:41,480 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf/1616060851e744078b51be4ce2d81b55] hfiles 2023-07-14 08:14:41,480 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf/1616060851e744078b51be4ce2d81b55 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,487 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:41,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:41,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:41,489 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:41,490 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. completed. 2023-07-14 08:14:41,490 DEBUG [rs(jenkins-hbase9.apache.org,39739,1689322343570)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:41,490 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:41,490 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:41,490 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,490 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:41,490 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:41,492 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,493 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:41,493 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:41,493 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,497 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf/891d4ec0c63f418aa76cf4351ab94c69, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 08:14:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,498 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 021fb7e89744bfbfbbb1e8dcdd40f2cc in 137ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,499 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 021fb7e89744bfbfbbb1e8dcdd40f2cc: 2023-07-14 08:14:41,500 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,500 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:41,500 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf/891d4ec0c63f418aa76cf4351ab94c69] hfiles 2023-07-14 08:14:41,500 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf/891d4ec0c63f418aa76cf4351ab94c69 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39739,1689322343570': 2023-07-14 08:14:41,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:14:41,526 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. completed. 2023-07-14 08:14:41,526 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:41,526 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:41,526 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:41,526 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,526 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:41,526 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:41,528 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:41,529 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:41,529 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:41,529 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:14:41,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:14:41,545 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 08:14:41,545 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:41,545 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:41,545 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,545 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:41,550 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,550 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:41,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,550 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,550 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:41,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:41,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,554 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,554 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,554 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:41,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:41,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:41,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:41,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:41,555 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,556 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:41,557 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:41,559 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,559 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,560 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,565 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:41,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:41,565 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:41,566 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:41,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:41,566 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,566 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:41,567 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:41,567 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,567 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,567 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:41,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:41,567 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:41,569 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:41,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:41,569 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:41,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:41,569 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:41,571 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,571 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:41,571 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:41,571 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,571 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:41,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 08:14:41,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,648 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689322481178Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689322481567 (+389 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689322481567Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689322481577 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689322481597 (+20 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689322481647 (+50 ms) 2023-07-14 08:14:41,660 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:41,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 481 msec 2023-07-14 08:14:41,789 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:41,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:41,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:41,791 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791 2023-07-14 08:14:41,791 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45081, tgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791, rawTgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:14:41,819 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:14:41,819 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314730750_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,820 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 08:14:41,828 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:41,896 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:41,897 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:41,898 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:41,898 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,300 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:14:43,312 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-8230664845592203121.jar 2023-07-14 08:14:43,313 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,313 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,419 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-6688823053420266588.jar 2023-07-14 08:14:43,420 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,420 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,421 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,422 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,422 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,423 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:43,424 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:14:43,424 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:14:43,425 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:14:43,425 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:14:43,426 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:14:43,428 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:14:43,429 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:14:43,429 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:14:43,430 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:14:43,431 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:14:43,432 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:43,433 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:43,435 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:43,435 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:43,435 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:43,436 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:43,437 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:45,482 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:14:45,487 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 08:14:45,633 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:45,634 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:45,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0006_000001 (auth:SIMPLE) 2023-07-14 08:14:51,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0006_000001 (auth:SIMPLE) 2023-07-14 08:14:55,025 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:14:55,028 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:14:55,078 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:55,078 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:14:55,079 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:14:55,079 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:55,080 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 08:14:55,080 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 08:14:55,080 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:55,081 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 08:14:55,081 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322481791/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 08:14:55,098 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,098 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 08:14:55,109 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322495109"}]},"ts":"1689322495109"} 2023-07-14 08:14:55,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 08:14:55,117 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 08:14:55,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, UNASSIGN}] 2023-07-14 08:14:55,124 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, UNASSIGN 2023-07-14 08:14:55,127 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, UNASSIGN 2023-07-14 08:14:55,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=021fb7e89744bfbfbbb1e8dcdd40f2cc, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:55,128 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322495128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322495128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322495128"}]},"ts":"1689322495128"} 2023-07-14 08:14:55,129 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b426f7dd47af26240c9121e61bf7dd07, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:55,129 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322495129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322495129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322495129"}]},"ts":"1689322495129"} 2023-07-14 08:14:55,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 021fb7e89744bfbfbbb1e8dcdd40f2cc, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:14:55,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure b426f7dd47af26240c9121e61bf7dd07, server=jenkins-hbase9.apache.org,39739,1689322343570}] 2023-07-14 08:14:55,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 08:14:55,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 021fb7e89744bfbfbbb1e8dcdd40f2cc, disabling compactions & flushes 2023-07-14 08:14:55,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. after waiting 0 ms 2023-07-14 08:14:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:55,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:55,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b426f7dd47af26240c9121e61bf7dd07, disabling compactions & flushes 2023-07-14 08:14:55,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:55,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:55,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. after waiting 0 ms 2023-07-14 08:14:55,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:55,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:55,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:55,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07. 2023-07-14 08:14:55,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b426f7dd47af26240c9121e61bf7dd07: 2023-07-14 08:14:55,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:55,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:55,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc. 2023-07-14 08:14:55,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 021fb7e89744bfbfbbb1e8dcdd40f2cc: 2023-07-14 08:14:55,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:55,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b426f7dd47af26240c9121e61bf7dd07, regionState=CLOSED 2023-07-14 08:14:55,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322495361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322495361"}]},"ts":"1689322495361"} 2023-07-14 08:14:55,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:55,362 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=021fb7e89744bfbfbbb1e8dcdd40f2cc, regionState=CLOSED 2023-07-14 08:14:55,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322495362"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322495362"}]},"ts":"1689322495362"} 2023-07-14 08:14:55,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-14 08:14:55,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure b426f7dd47af26240c9121e61bf7dd07, server=jenkins-hbase9.apache.org,39739,1689322343570 in 231 msec 2023-07-14 08:14:55,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b426f7dd47af26240c9121e61bf7dd07, UNASSIGN in 245 msec 2023-07-14 08:14:55,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-14 08:14:55,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 021fb7e89744bfbfbbb1e8dcdd40f2cc, server=jenkins-hbase9.apache.org,43891,1689322343628 in 234 msec 2023-07-14 08:14:55,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 08:14:55,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=021fb7e89744bfbfbbb1e8dcdd40f2cc, UNASSIGN in 251 msec 2023-07-14 08:14:55,375 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322495375"}]},"ts":"1689322495375"} 2023-07-14 08:14:55,377 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 08:14:55,378 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 08:14:55,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 280 msec 2023-07-14 08:14:55,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 08:14:55,411 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 08:14:55,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,416 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,417 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,418 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,422 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:55,422 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:55,423 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,423 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,423 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,422 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,423 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 08:14:55,423 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 08:14:55,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-14 08:14:55,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:55,425 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:55,425 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:55,425 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:55,425 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/recovered.edits] 2023-07-14 08:14:55,425 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:55,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-14 08:14:55,425 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:55,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 08:14:55,426 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/recovered.edits] 2023-07-14 08:14:55,432 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf/891d4ec0c63f418aa76cf4351ab94c69 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/cf/891d4ec0c63f418aa76cf4351ab94c69 2023-07-14 08:14:55,438 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf/1616060851e744078b51be4ce2d81b55 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/cf/1616060851e744078b51be4ce2d81b55 2023-07-14 08:14:55,443 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc/recovered.edits/9.seqid 2023-07-14 08:14:55,444 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/021fb7e89744bfbfbbb1e8dcdd40f2cc 2023-07-14 08:14:55,447 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07/recovered.edits/9.seqid 2023-07-14 08:14:55,448 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/b426f7dd47af26240c9121e61bf7dd07 2023-07-14 08:14:55,448 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 08:14:55,452 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,458 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 08:14:55,475 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 08:14:55,476 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,476 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 08:14:55,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322495476"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:55,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322495476"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:55,479 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:14:55,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b426f7dd47af26240c9121e61bf7dd07, NAME => 'testtb-testEmptyExportFileSystemState,,1689322479008.b426f7dd47af26240c9121e61bf7dd07.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 021fb7e89744bfbfbbb1e8dcdd40f2cc, NAME => 'testtb-testEmptyExportFileSystemState,1,1689322479008.021fb7e89744bfbfbbb1e8dcdd40f2cc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:14:55,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 08:14:55,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322495480"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:55,482 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 08:14:55,484 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:55,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 72 msec 2023-07-14 08:14:55,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 08:14:55,527 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 08:14:55,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 08:14:55,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:55,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 08:14:55,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:55,587 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 755) Potentially hanging thread: hconnection-0x291cea62-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:50782 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:36459 from appattempt_1689322352998_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x291cea62-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x291cea62-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4842 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1248575493_1 at /127.0.0.1:50738 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (362682804) connection to jenkins-hbase9.apache.org/172.31.2.10:34967 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:49362 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_997057116_17 at /127.0.0.1:40274 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1216 (was 1220), ProcessCount=189 (was 192), AvailableMemoryMB=1691 (was 803) - AvailableMemoryMB LEAK? - 2023-07-14 08:14:55,588 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 08:14:55,624 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=1216, ProcessCount=189, AvailableMemoryMB=1689 2023-07-14 08:14:55,625 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 08:14:55,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:14:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:55,631 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:55,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 08:14:55,632 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:55,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:14:55,635 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:55,635 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:55,636 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 empty. 2023-07-14 08:14:55,636 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f empty. 2023-07-14 08:14:55,636 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:55,636 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:55,636 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 08:14:55,696 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:55,698 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4c1878be0bf9e4099556bc993763506f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:55,698 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 57d9989331434ae01eec8ff7d9af1da1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp 2023-07-14 08:14:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:14:55,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:55,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 4c1878be0bf9e4099556bc993763506f, disabling compactions & flushes 2023-07-14 08:14:55,767 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:55,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:55,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. after waiting 0 ms 2023-07-14 08:14:55,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:55,767 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:55,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 4c1878be0bf9e4099556bc993763506f: 2023-07-14 08:14:55,771 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:55,771 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 57d9989331434ae01eec8ff7d9af1da1, disabling compactions & flushes 2023-07-14 08:14:55,771 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:55,771 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:55,771 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. after waiting 0 ms 2023-07-14 08:14:55,771 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:55,771 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:55,771 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 57d9989331434ae01eec8ff7d9af1da1: 2023-07-14 08:14:55,777 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:55,778 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322495778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322495778"}]},"ts":"1689322495778"} 2023-07-14 08:14:55,779 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322495778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322495778"}]},"ts":"1689322495778"} 2023-07-14 08:14:55,795 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:55,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:55,797 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322495797"}]},"ts":"1689322495797"} 2023-07-14 08:14:55,799 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 08:14:55,803 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:55,805 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:55,805 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:55,805 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:55,805 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:55,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, ASSIGN}] 2023-07-14 08:14:55,808 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, ASSIGN 2023-07-14 08:14:55,809 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, ASSIGN 2023-07-14 08:14:55,809 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43891,1689322343628; forceNewPlan=false, retain=false 2023-07-14 08:14:55,809 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44465,1689322343497; forceNewPlan=false, retain=false 2023-07-14 08:14:55,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:14:55,959 INFO [jenkins-hbase9:45715] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:55,963 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=57d9989331434ae01eec8ff7d9af1da1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:55,963 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322495963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322495963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322495963"}]},"ts":"1689322495963"} 2023-07-14 08:14:55,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 57d9989331434ae01eec8ff7d9af1da1, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:14:55,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4c1878be0bf9e4099556bc993763506f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:55,967 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322495963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322495963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322495963"}]},"ts":"1689322495963"} 2023-07-14 08:14:55,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 4c1878be0bf9e4099556bc993763506f, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:14:56,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:56,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c1878be0bf9e4099556bc993763506f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. service=AccessControlService 2023-07-14 08:14:56,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:56,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57d9989331434ae01eec8ff7d9af1da1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:14:56,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. service=AccessControlService 2023-07-14 08:14:56,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:56,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:56,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,186 INFO [StoreOpener-4c1878be0bf9e4099556bc993763506f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,194 DEBUG [StoreOpener-4c1878be0bf9e4099556bc993763506f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf 2023-07-14 08:14:56,194 DEBUG [StoreOpener-4c1878be0bf9e4099556bc993763506f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf 2023-07-14 08:14:56,194 INFO [StoreOpener-57d9989331434ae01eec8ff7d9af1da1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,195 INFO [StoreOpener-4c1878be0bf9e4099556bc993763506f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c1878be0bf9e4099556bc993763506f columnFamilyName cf 2023-07-14 08:14:56,195 INFO [StoreOpener-4c1878be0bf9e4099556bc993763506f-1] regionserver.HStore(310): Store=4c1878be0bf9e4099556bc993763506f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:56,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,200 DEBUG [StoreOpener-57d9989331434ae01eec8ff7d9af1da1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf 2023-07-14 08:14:56,200 DEBUG [StoreOpener-57d9989331434ae01eec8ff7d9af1da1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf 2023-07-14 08:14:56,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,205 INFO [StoreOpener-57d9989331434ae01eec8ff7d9af1da1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57d9989331434ae01eec8ff7d9af1da1 columnFamilyName cf 2023-07-14 08:14:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:14:56,215 INFO [StoreOpener-57d9989331434ae01eec8ff7d9af1da1-1] regionserver.HStore(310): Store=57d9989331434ae01eec8ff7d9af1da1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:56,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:56,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4c1878be0bf9e4099556bc993763506f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69036734, jitterRate=0.02872750163078308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:56,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4c1878be0bf9e4099556bc993763506f: 2023-07-14 08:14:56,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f., pid=109, masterSystemTime=1689322496127 2023-07-14 08:14:56,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:56,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:56,227 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4c1878be0bf9e4099556bc993763506f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:56,227 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322496227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322496227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322496227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322496227"}]},"ts":"1689322496227"} 2023-07-14 08:14:56,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:14:56,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-14 08:14:56,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 4c1878be0bf9e4099556bc993763506f, server=jenkins-hbase9.apache.org,43891,1689322343628 in 254 msec 2023-07-14 08:14:56,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, ASSIGN in 430 msec 2023-07-14 08:14:56,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:56,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 57d9989331434ae01eec8ff7d9af1da1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62417848, jitterRate=-0.06990158557891846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:56,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 57d9989331434ae01eec8ff7d9af1da1: 2023-07-14 08:14:56,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:14:56,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1., pid=108, masterSystemTime=1689322496120 2023-07-14 08:14:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:56,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:56,248 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=57d9989331434ae01eec8ff7d9af1da1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:56,248 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322496248"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322496248"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322496248"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322496248"}]},"ts":"1689322496248"} 2023-07-14 08:14:56,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-14 08:14:56,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 57d9989331434ae01eec8ff7d9af1da1, server=jenkins-hbase9.apache.org,44465,1689322343497 in 285 msec 2023-07-14 08:14:56,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-14 08:14:56,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, ASSIGN in 448 msec 2023-07-14 08:14:56,256 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:56,256 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322496256"}]},"ts":"1689322496256"} 2023-07-14 08:14:56,258 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 08:14:56,260 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:56,260 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 08:14:56,263 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 08:14:56,265 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:56,265 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:56,265 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:56,266 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:56,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:56,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:56,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:56,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:56,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 644 msec 2023-07-14 08:14:56,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:14:56,742 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 08:14:56,743 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-14 08:14:56,743 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:56,749 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-14 08:14:56,749 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:56,749 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-14 08:14:56,753 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:14:56,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322496753 (current time:1689322496753). 2023-07-14 08:14:56,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:56,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x511a8fb3 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:56,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45cb955b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:56,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:56,807 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:56,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x511a8fb3 to 127.0.0.1:54201 2023-07-14 08:14:56,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:56,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x4165baba to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:56,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4407d232, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:56,839 DEBUG [hconnection-0x5d7fe6a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:56,848 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:56,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:56,858 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4165baba to 127.0.0.1:54201 2023-07-14 08:14:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 08:14:56,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:56,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:14:56,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:14:56,864 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:14:56,865 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689323096865 2023-07-14 08:14:56,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:14:56,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,867 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:56,867 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:56,868 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:14:56,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:14:56,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-14 08:14:56,875 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:14:56,876 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689323096876 2023-07-14 08:14:56,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,942 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 08:14:56,942 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:56,943 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 08:14:56,944 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 08:14:56,944 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,944 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,947 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:56,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:56,947 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:56,947 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:56,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:56,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:56,948 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,948 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,948 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:56,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,949 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:56,949 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 08:14:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:14:56,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 08:14:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 08:14:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:14:56,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:14:56,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,963 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:14:56,963 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:56,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,966 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:14:56,981 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:56,981 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 08:14:56,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,981 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:14:56,982 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:14:56,982 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:14:56,982 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:14:56,982 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:56,981 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:56,984 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:14:56,984 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:14:56,984 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:14:56,984 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:14:56,984 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:14:56,985 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:14:56,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:56,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:56,990 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:56,994 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:56,994 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:56,995 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,995 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:56,996 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:56,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:56,996 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:56,996 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,997 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:56,997 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,997 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:56,997 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:56,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:56,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:56,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:14:57,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a64c014[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:57,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:14:57,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a64c014[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:57,004 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 08:14:57,004 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:14:57,005 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,006 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:14:57,006 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:14:57,006 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:14:57,006 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:57,006 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,006 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,006 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:57,008 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:14:57,008 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:57,008 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:14:57,010 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:57,010 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:57,021 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:57,022 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:57,022 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. started... 2023-07-14 08:14:57,022 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:57,026 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:57,024 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c1878be0bf9e4099556bc993763506f: 2023-07-14 08:14:57,027 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,027 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:57,027 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:57,026 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. started... 2023-07-14 08:14:57,030 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 57d9989331434ae01eec8ff7d9af1da1: 2023-07-14 08:14:57,030 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,030 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:57,030 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:57,114 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. completed. 2023-07-14 08:14:57,114 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:57,114 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:57,114 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:57,114 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,115 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:14:57,115 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:57,116 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,116 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:14:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,117 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:57,117 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:14:57,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:14:57,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 08:14:57,156 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. completed. 2023-07-14 08:14:57,156 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:57,156 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:57,156 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:57,156 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,156 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:14:57,156 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:57,158 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:14:57,158 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,158 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,158 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:14:57,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:14:57,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 08:14:57,167 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 08:14:57,167 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:57,167 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:57,167 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,167 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:57,169 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:57,169 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,169 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,169 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,170 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:57,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:57,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:57,170 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:57,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,171 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,171 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,174 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,175 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,177 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,186 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:57,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:57,186 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,190 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,190 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:57,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:57,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:57,192 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:57,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:57,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:57,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:57,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 08:14:57,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,485 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689322496866Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322497186 (+320 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322497192 (+6 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322497217 (+25 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322497275 (+58 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689322497484 (+209 ms) 2023-07-14 08:14:57,488 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:14:57,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 621 msec 2023-07-14 08:14:57,492 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:57,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:57,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:57,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44465] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:57,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43891] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:57,531 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,531 DEBUG [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:57,532 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:57,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:14:57,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322497554 (current time:1689322497554). 2023-07-14 08:14:57,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:57,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x405006c5 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:57,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@623892ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:57,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:57,573 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:57,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x405006c5 to 127.0.0.1:54201 2023-07-14 08:14:57,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:57,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(139): Connect 0x686ef452 to 127.0.0.1:54201 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:57,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2848a1b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:57,638 DEBUG [hconnection-0xec3e3ea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:57,643 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:57,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:57,652 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:57,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x686ef452 to 127.0.0.1:54201 2023-07-14 08:14:57,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:57,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 08:14:57,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:57,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:14:57,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:14:57,658 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:14:57,659 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689323097659 2023-07-14 08:14:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:14:57,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,662 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:57,662 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:57,665 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:14:57,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:14:57,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-14 08:14:57,668 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:14:57,669 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689323097669 2023-07-14 08:14:57,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,718 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 08:14:57,718 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:57,720 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 08:14:57,720 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 08:14:57,720 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,721 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,722 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:57,722 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:57,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:57,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:57,722 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,722 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:57,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,723 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,723 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,724 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,724 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:57,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 08:14:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:14:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 08:14:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,725 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:14:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 08:14:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,725 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:14:57,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,726 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:14:57,726 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:57,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,738 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:14:57,738 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:57,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,743 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:14:57,743 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39739,1689322343570' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:14:57,745 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:14:57,747 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,747 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,747 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:57,748 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,748 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44465,1689322343497' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2232e8f6[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43891,1689322343628' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:14:57,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2232e8f6[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:57,754 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 08:14:57,754 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,762 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:57,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:57,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:57,765 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:57,766 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:14:57,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:14:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,766 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,767 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:14:57,767 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:14:57,767 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39739,1689322343570' in zk 2023-07-14 08:14:57,768 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,768 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:57,769 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:14:57,769 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:57,769 DEBUG [member: 'jenkins-hbase9.apache.org,39739,1689322343570' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:14:57,770 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:57,770 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:57,770 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:57,770 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:57,770 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:57,770 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:57,770 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. started... 2023-07-14 08:14:57,771 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. started... 2023-07-14 08:14:57,771 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4c1878be0bf9e4099556bc993763506f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 08:14:57,772 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 57d9989331434ae01eec8ff7d9af1da1 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 08:14:57,885 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/.tmp/cf/2bde2c5b17fb428b8245b631f0b20fcf 2023-07-14 08:14:57,892 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/.tmp/cf/2bde2c5b17fb428b8245b631f0b20fcf as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf/2bde2c5b17fb428b8245b631f0b20fcf 2023-07-14 08:14:57,898 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf/2bde2c5b17fb428b8245b631f0b20fcf, entries=47, sequenceid=6, filesize=8.0 K 2023-07-14 08:14:57,899 INFO [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 4c1878be0bf9e4099556bc993763506f in 128ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:57,901 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c1878be0bf9e4099556bc993763506f: 2023-07-14 08:14:57,901 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,901 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:57,901 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf/2bde2c5b17fb428b8245b631f0b20fcf] hfiles 2023-07-14 08:14:57,901 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf/2bde2c5b17fb428b8245b631f0b20fcf for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,945 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. completed. 2023-07-14 08:14:57,945 DEBUG [rs(jenkins-hbase9.apache.org,43891,1689322343628)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:14:57,945 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:57,945 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:57,945 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,945 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:14:57,946 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,43891,1689322343628' in zk 2023-07-14 08:14:57,948 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:14:57,948 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,948 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:57,948 DEBUG [member: 'jenkins-hbase9.apache.org,43891,1689322343628' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:14:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:57,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:57,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:57,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:57,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:57,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,43891,1689322343628': 2023-07-14 08:14:57,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43891,1689322343628' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 08:14:57,965 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:57,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:57,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:57,967 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:58,250 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/.tmp/cf/c2f7cb9fc2a445d1a2113ffc27334b77 2023-07-14 08:14:58,257 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/.tmp/cf/c2f7cb9fc2a445d1a2113ffc27334b77 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf/c2f7cb9fc2a445d1a2113ffc27334b77 2023-07-14 08:14:58,267 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:58,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:58,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:58,269 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:14:58,276 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf/c2f7cb9fc2a445d1a2113ffc27334b77, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 08:14:58,277 INFO [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 57d9989331434ae01eec8ff7d9af1da1 in 505ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:58,277 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 57d9989331434ae01eec8ff7d9af1da1: 2023-07-14 08:14:58,278 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,278 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:58,278 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf/c2f7cb9fc2a445d1a2113ffc27334b77] hfiles 2023-07-14 08:14:58,278 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf/c2f7cb9fc2a445d1a2113ffc27334b77 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,393 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. completed. 2023-07-14 08:14:58,393 DEBUG [rs(jenkins-hbase9.apache.org,44465,1689322343497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:14:58,393 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:58,393 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:58,393 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,393 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:14:58,393 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44465,1689322343497' in zk 2023-07-14 08:14:58,397 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,397 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:14:58,397 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:58,397 DEBUG [member: 'jenkins-hbase9.apache.org,44465,1689322343497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:14:58,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44465,1689322343497': 2023-07-14 08:14:58,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44465,1689322343497' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 08:14:58,405 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 08:14:58,405 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:58,405 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:58,405 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,405 INFO [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:58,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:58,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:58,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:58,408 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:58,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:58,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,410 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,411 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:58,411 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:58,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,415 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,415 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,416 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,422 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:58,422 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:58,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:58,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:58,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:58,422 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:58,422 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:58,423 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:58,423 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:58,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:58,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:58,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:58,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:58,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:58,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:58,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:58,423 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:58,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,424 DEBUG [(jenkins-hbase9.apache.org,45715,1689322341751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:58,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 08:14:58,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,643 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689322497660Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689322498424 (+764 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689322498424Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689322498446 (+22 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689322498523 (+77 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689322498642 (+119 ms) 2023-07-14 08:14:58,646 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:14:58,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 985 msec 2023-07-14 08:14:58,769 DEBUG [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:58,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:14:58,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:58,770 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770 2023-07-14 08:14:58,771 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45081, tgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770, rawTgtDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770, srcFsUri=hdfs://localhost:45081, srcDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:14:58,810 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c 2023-07-14 08:14:58,810 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1612946174_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,810 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45081, inputRoot=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c, snapshotDir=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 08:14:58,825 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:14:58,925 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:58,925 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:58,926 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:58,926 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:59,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0006_000001 (auth:SIMPLE) 2023-07-14 08:15:00,169 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-4995959024728950569.jar 2023-07-14 08:15:00,169 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,170 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,246 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/hadoop-9065382762144297837.jar 2023-07-14 08:15:00,246 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,247 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,247 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,248 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,248 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,248 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:00,249 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:15:00,249 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:15:00,249 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:15:00,250 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:15:00,250 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:15:00,251 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:15:00,251 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:15:00,252 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:15:00,252 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:15:00,253 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:15:00,253 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:00,254 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:00,254 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:15:00,255 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:00,255 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:00,256 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:15:00,256 DEBUG [Listener at jenkins-hbase9.apache.org/36457] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:15:00,979 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:15:01,512 WARN [Listener at jenkins-hbase9.apache.org/36457] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:15:01,514 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 08:15:01,517 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 08:15:01,612 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:15:01,612 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:15:02,388 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:08,757 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:11,109 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:17,757 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:15:17,758 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:15:17,770 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:17,770 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:15:17,770 INFO [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:15:17,771 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:17,771 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 08:15:17,771 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 08:15:17,771 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_997057116_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:17,772 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 08:15:17,772 DEBUG [Listener at jenkins-hbase9.apache.org/36457] snapshot.TestExportSnapshot(367): hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/export-test/export-1689322498770/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 08:15:17,778 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:17,779 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:17,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:17,783 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322517782"}]},"ts":"1689322517782"} 2023-07-14 08:15:17,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:17,784 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 08:15:17,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:17,890 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 08:15:17,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, UNASSIGN}] 2023-07-14 08:15:17,891 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, UNASSIGN 2023-07-14 08:15:17,893 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, UNASSIGN 2023-07-14 08:15:17,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=57d9989331434ae01eec8ff7d9af1da1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:15:17,893 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4c1878be0bf9e4099556bc993763506f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:15:17,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322517893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322517893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322517893"}]},"ts":"1689322517893"} 2023-07-14 08:15:17,894 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322517893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322517893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322517893"}]},"ts":"1689322517893"} 2023-07-14 08:15:17,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 57d9989331434ae01eec8ff7d9af1da1, server=jenkins-hbase9.apache.org,44465,1689322343497}] 2023-07-14 08:15:17,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 4c1878be0bf9e4099556bc993763506f, server=jenkins-hbase9.apache.org,43891,1689322343628}] 2023-07-14 08:15:18,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:15:18,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:15:18,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4c1878be0bf9e4099556bc993763506f, disabling compactions & flushes 2023-07-14 08:15:18,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 57d9989331434ae01eec8ff7d9af1da1, disabling compactions & flushes 2023-07-14 08:15:18,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:15:18,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:15:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:15:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:15:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. after waiting 0 ms 2023-07-14 08:15:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:15:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. after waiting 0 ms 2023-07-14 08:15:18,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:15:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:18,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:18,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1. 2023-07-14 08:15:18,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 57d9989331434ae01eec8ff7d9af1da1: 2023-07-14 08:15:18,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:18,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:15:18,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:18,084 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=57d9989331434ae01eec8ff7d9af1da1, regionState=CLOSED 2023-07-14 08:15:18,084 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322518084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322518084"}]},"ts":"1689322518084"} 2023-07-14 08:15:18,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f. 2023-07-14 08:15:18,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4c1878be0bf9e4099556bc993763506f: 2023-07-14 08:15:18,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:18,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4c1878be0bf9e4099556bc993763506f 2023-07-14 08:15:18,089 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4c1878be0bf9e4099556bc993763506f, regionState=CLOSED 2023-07-14 08:15:18,090 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322518089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322518089"}]},"ts":"1689322518089"} 2023-07-14 08:15:18,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 08:15:18,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 57d9989331434ae01eec8ff7d9af1da1, server=jenkins-hbase9.apache.org,44465,1689322343497 in 193 msec 2023-07-14 08:15:18,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 08:15:18,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 4c1878be0bf9e4099556bc993763506f, server=jenkins-hbase9.apache.org,43891,1689322343628 in 196 msec 2023-07-14 08:15:18,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4c1878be0bf9e4099556bc993763506f, UNASSIGN in 202 msec 2023-07-14 08:15:18,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-14 08:15:18,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=57d9989331434ae01eec8ff7d9af1da1, UNASSIGN in 205 msec 2023-07-14 08:15:18,099 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322518099"}]},"ts":"1689322518099"} 2023-07-14 08:15:18,101 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 08:15:18,228 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 08:15:18,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 450 msec 2023-07-14 08:15:18,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:18,388 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 08:15:18,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,393 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,394 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,396 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44465] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,401 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:15:18,405 DEBUG [HFileArchiver-28] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f 2023-07-14 08:15:18,406 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/recovered.edits] 2023-07-14 08:15:18,408 DEBUG [HFileArchiver-28] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf, FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/recovered.edits] 2023-07-14 08:15:18,412 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf/c2f7cb9fc2a445d1a2113ffc27334b77 to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/cf/c2f7cb9fc2a445d1a2113ffc27334b77 2023-07-14 08:15:18,417 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf/2bde2c5b17fb428b8245b631f0b20fcf to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/cf/2bde2c5b17fb428b8245b631f0b20fcf 2023-07-14 08:15:18,417 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1/recovered.edits/9.seqid 2023-07-14 08:15:18,418 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/57d9989331434ae01eec8ff7d9af1da1 2023-07-14 08:15:18,421 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/recovered.edits/9.seqid to hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f/recovered.edits/9.seqid 2023-07-14 08:15:18,421 DEBUG [HFileArchiver-28] backup.HFileArchiver(596): Deleted hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4c1878be0bf9e4099556bc993763506f 2023-07-14 08:15:18,422 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 08:15:18,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,433 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 08:15:18,438 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 08:15:18,439 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,439 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 08:15:18,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322518439"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:18,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322518439"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:18,441 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:15:18,441 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 57d9989331434ae01eec8ff7d9af1da1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689322495626.57d9989331434ae01eec8ff7d9af1da1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4c1878be0bf9e4099556bc993763506f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322495626.4c1878be0bf9e4099556bc993763506f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:15:18,441 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 08:15:18,441 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322518441"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:18,447 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 08:15:18,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 232 msec 2023-07-14 08:15:18,683 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,683 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,683 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,683 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 08:15:18,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:18,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:18,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 08:15:18,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 08:15:18,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:18,743 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:18,744 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:15:18,744 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:15:18,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 08:15:18,744 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:15:18,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 08:15:18,745 INFO [Listener at jenkins-hbase9.apache.org/36457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 08:15:18,752 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 08:15:18,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 08:15:18,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45715] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:18,794 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 763), OpenFileDescriptor=899 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1192 (was 1216), ProcessCount=190 (was 189) - ProcessCount LEAK? -, AvailableMemoryMB=1527 (was 1689) 2023-07-14 08:15:18,794 WARN [Listener at jenkins-hbase9.apache.org/36457] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 08:15:18,794 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 08:15:18,843 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:22,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322352998_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:23,663 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:15:32,983 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:47,104 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 08:15:47,105 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:47,222 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 08:15:47,233 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 08:15:47,235 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 08:15:47,249 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:47,353 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 08:15:47,353 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 08:15:47,353 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 08:15:47,354 INFO [Listener at jenkins-hbase9.apache.org/36457] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 08:15:47,354 DEBUG [Listener at jenkins-hbase9.apache.org/36457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fb7de76 to 127.0.0.1:54201 2023-07-14 08:15:47,354 DEBUG [Listener at jenkins-hbase9.apache.org/36457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,354 DEBUG [Listener at jenkins-hbase9.apache.org/36457] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 08:15:47,354 DEBUG [Listener at jenkins-hbase9.apache.org/36457] util.JVMClusterUtil(257): Found active master hash=1769873474, stopped=false 2023-07-14 08:15:47,354 DEBUG [Listener at jenkins-hbase9.apache.org/36457] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,355 DEBUG [Listener at jenkins-hbase9.apache.org/36457] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 08:15:47,355 INFO [Listener at jenkins-hbase9.apache.org/36457] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:15:47,356 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:47,356 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:47,356 INFO [Listener at jenkins-hbase9.apache.org/36457] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 08:15:47,356 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:47,356 DEBUG [Listener at jenkins-hbase9.apache.org/36457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16564da0 to 127.0.0.1:54201 2023-07-14 08:15:47,356 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:47,357 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:15:47,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:47,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:47,357 DEBUG [Listener at jenkins-hbase9.apache.org/36457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,357 INFO [Listener at jenkins-hbase9.apache.org/36457] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44465,1689322343497' ***** 2023-07-14 08:15:47,357 DEBUG [Listener at jenkins-hbase9.apache.org/36457] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,357 INFO [Listener at jenkins-hbase9.apache.org/36457] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 08:15:47,358 INFO [Listener at jenkins-hbase9.apache.org/36457] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39739,1689322343570' ***** 2023-07-14 08:15:47,358 DEBUG [Listener at jenkins-hbase9.apache.org/36457] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,358 INFO [Listener at jenkins-hbase9.apache.org/36457] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 08:15:47,358 INFO [Listener at jenkins-hbase9.apache.org/36457] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,43891,1689322343628' ***** 2023-07-14 08:15:47,358 DEBUG [Listener at jenkins-hbase9.apache.org/36457] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,358 INFO [Listener at jenkins-hbase9.apache.org/36457] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 08:15:47,358 INFO [RS:0;jenkins-hbase9:44465] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 08:15:47,358 INFO [RS:0;jenkins-hbase9:44465] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 08:15:47,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:47,358 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 08:15:47,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:47,359 INFO [RS:2;jenkins-hbase9:43891] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 08:15:47,359 INFO [RS:2;jenkins-hbase9:43891] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 08:15:47,359 INFO [RS:2;jenkins-hbase9:43891] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 08:15:47,359 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:15:47,359 DEBUG [RS:2;jenkins-hbase9:43891] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12ce379a to 127.0.0.1:54201 2023-07-14 08:15:47,359 DEBUG [RS:2;jenkins-hbase9:43891] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,358 INFO [RS:0;jenkins-hbase9:44465] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 08:15:47,362 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,43891,1689322343628; all regions closed. 2023-07-14 08:15:47,362 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(3305): Received CLOSE for 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:15:47,362 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:15:47,363 DEBUG [RS:0;jenkins-hbase9:44465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x217a9942 to 127.0.0.1:54201 2023-07-14 08:15:47,363 DEBUG [RS:0;jenkins-hbase9:44465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,362 INFO [RS:1;jenkins-hbase9:39739] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 08:15:47,359 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 08:15:47,364 INFO [RS:1;jenkins-hbase9:39739] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 08:15:47,364 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 08:15:47,364 INFO [RS:1;jenkins-hbase9:39739] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 08:15:47,364 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(3305): Received CLOSE for 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:15:47,364 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:15:47,364 DEBUG [RS:1;jenkins-hbase9:39739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748530fb to 127.0.0.1:54201 2023-07-14 08:15:47,364 DEBUG [RS:1;jenkins-hbase9:39739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9463064d38a2a0e09e02f6f1468f2a44, disabling compactions & flushes 2023-07-14 08:15:47,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 515681d4dd0e8a9929ac3d280c7e2536, disabling compactions & flushes 2023-07-14 08:15:47,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:15:47,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:15:47,369 INFO [RS:1;jenkins-hbase9:39739] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 08:15:47,370 INFO [RS:1;jenkins-hbase9:39739] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 08:15:47,370 INFO [RS:1;jenkins-hbase9:39739] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 08:15:47,369 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 08:15:47,370 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 08:15:47,370 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1478): Online Regions={9463064d38a2a0e09e02f6f1468f2a44=hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44.} 2023-07-14 08:15:47,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:15:47,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:15:47,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. after waiting 0 ms 2023-07-14 08:15:47,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:15:47,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. after waiting 0 ms 2023-07-14 08:15:47,370 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 08:15:47,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:15:47,370 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1478): Online Regions={515681d4dd0e8a9929ac3d280c7e2536=hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536., 1588230740=hbase:meta,,1.1588230740} 2023-07-14 08:15:47,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 9463064d38a2a0e09e02f6f1468f2a44 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 08:15:47,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 515681d4dd0e8a9929ac3d280c7e2536 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 08:15:47,371 DEBUG [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1504): Waiting on 9463064d38a2a0e09e02f6f1468f2a44 2023-07-14 08:15:47,371 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1504): Waiting on 1588230740, 515681d4dd0e8a9929ac3d280c7e2536 2023-07-14 08:15:47,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 08:15:47,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 08:15:47,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 08:15:47,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 08:15:47,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 08:15:47,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 08:15:47,394 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:47,395 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:47,395 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:47,399 DEBUG [RS:2;jenkins-hbase9:43891] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs 2023-07-14 08:15:47,399 INFO [RS:2;jenkins-hbase9:43891] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43891%2C1689322343628:(num 1689322346126) 2023-07-14 08:15:47,399 DEBUG [RS:2;jenkins-hbase9:43891] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,399 INFO [RS:2;jenkins-hbase9:43891] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:47,399 INFO [RS:2;jenkins-hbase9:43891] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 08:15:47,400 INFO [RS:2;jenkins-hbase9:43891] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 08:15:47,400 INFO [RS:2;jenkins-hbase9:43891] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 08:15:47,400 INFO [RS:2;jenkins-hbase9:43891] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 08:15:47,400 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:47,401 INFO [RS:2;jenkins-hbase9:43891] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43891 2023-07-14 08:15:47,420 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:15:47,420 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:47,420 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:15:47,420 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:47,425 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:47,435 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43891,1689322343628 2023-07-14 08:15:47,435 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:47,443 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43891,1689322343628] 2023-07-14 08:15:47,450 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43891,1689322343628; numProcessing=1 2023-07-14 08:15:47,451 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43891,1689322343628 already deleted, retry=false 2023-07-14 08:15:47,451 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43891,1689322343628 expired; onlineServers=2 2023-07-14 08:15:47,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/.tmp/l/e02bd7e6c4834e2ea48e3e5f84fa3274 2023-07-14 08:15:47,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/.tmp/info/61ab4c8634b9421a9f1e2b9d65079271 2023-07-14 08:15:47,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/.tmp/info/d3994d1443a140ea9a31c4824a316483 2023-07-14 08:15:47,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e02bd7e6c4834e2ea48e3e5f84fa3274 2023-07-14 08:15:47,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/.tmp/l/e02bd7e6c4834e2ea48e3e5f84fa3274 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/l/e02bd7e6c4834e2ea48e3e5f84fa3274 2023-07-14 08:15:47,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61ab4c8634b9421a9f1e2b9d65079271 2023-07-14 08:15:47,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/.tmp/info/d3994d1443a140ea9a31c4824a316483 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/info/d3994d1443a140ea9a31c4824a316483 2023-07-14 08:15:47,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e02bd7e6c4834e2ea48e3e5f84fa3274 2023-07-14 08:15:47,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/l/e02bd7e6c4834e2ea48e3e5f84fa3274, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 08:15:47,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 9463064d38a2a0e09e02f6f1468f2a44 in 139ms, sequenceid=18, compaction requested=false 2023-07-14 08:15:47,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/info/d3994d1443a140ea9a31c4824a316483, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 08:15:47,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 515681d4dd0e8a9929ac3d280c7e2536 in 158ms, sequenceid=6, compaction requested=false 2023-07-14 08:15:47,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/acl/9463064d38a2a0e09e02f6f1468f2a44/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 08:15:47,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:15:47,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9463064d38a2a0e09e02f6f1468f2a44: 2023-07-14 08:15:47,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689322347419.9463064d38a2a0e09e02f6f1468f2a44. 2023-07-14 08:15:47,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/.tmp/rep_barrier/34373315780e40c88ac2a3fc7a6fd9ef 2023-07-14 08:15:47,543 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:47,543 INFO [RS:2;jenkins-hbase9:43891] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,43891,1689322343628; zookeeper connection closed. 2023-07-14 08:15:47,543 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:43891-0x10162d605320003, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:47,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/namespace/515681d4dd0e8a9929ac3d280c7e2536/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:47,546 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1897bd66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1897bd66 2023-07-14 08:15:47,546 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34373315780e40c88ac2a3fc7a6fd9ef 2023-07-14 08:15:47,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:15:47,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 515681d4dd0e8a9929ac3d280c7e2536: 2023-07-14 08:15:47,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689322346675.515681d4dd0e8a9929ac3d280c7e2536. 2023-07-14 08:15:47,571 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44465,1689322343497; all regions closed. 2023-07-14 08:15:47,571 DEBUG [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 08:15:47,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/.tmp/table/5e4a7dc9f02d4ce2a681c32d3e536160 2023-07-14 08:15:47,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e4a7dc9f02d4ce2a681c32d3e536160 2023-07-14 08:15:47,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/.tmp/info/61ab4c8634b9421a9f1e2b9d65079271 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/info/61ab4c8634b9421a9f1e2b9d65079271 2023-07-14 08:15:47,591 DEBUG [RS:0;jenkins-hbase9:44465] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs 2023-07-14 08:15:47,591 INFO [RS:0;jenkins-hbase9:44465] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44465%2C1689322343497:(num 1689322346125) 2023-07-14 08:15:47,591 DEBUG [RS:0;jenkins-hbase9:44465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,591 INFO [RS:0;jenkins-hbase9:44465] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:47,592 INFO [RS:0;jenkins-hbase9:44465] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 08:15:47,593 INFO [RS:0;jenkins-hbase9:44465] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 08:15:47,593 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:47,593 INFO [RS:0;jenkins-hbase9:44465] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 08:15:47,593 INFO [RS:0;jenkins-hbase9:44465] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 08:15:47,595 INFO [RS:0;jenkins-hbase9:44465] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44465 2023-07-14 08:15:47,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61ab4c8634b9421a9f1e2b9d65079271 2023-07-14 08:15:47,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/info/61ab4c8634b9421a9f1e2b9d65079271, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 08:15:47,601 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/.tmp/rep_barrier/34373315780e40c88ac2a3fc7a6fd9ef as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/rep_barrier/34373315780e40c88ac2a3fc7a6fd9ef 2023-07-14 08:15:47,604 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:15:47,604 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44465,1689322343497 2023-07-14 08:15:47,610 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:47,611 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44465,1689322343497] 2023-07-14 08:15:47,611 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44465,1689322343497; numProcessing=2 2023-07-14 08:15:47,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34373315780e40c88ac2a3fc7a6fd9ef 2023-07-14 08:15:47,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/rep_barrier/34373315780e40c88ac2a3fc7a6fd9ef, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 08:15:47,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/.tmp/table/5e4a7dc9f02d4ce2a681c32d3e536160 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/table/5e4a7dc9f02d4ce2a681c32d3e536160 2023-07-14 08:15:47,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e4a7dc9f02d4ce2a681c32d3e536160 2023-07-14 08:15:47,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/table/5e4a7dc9f02d4ce2a681c32d3e536160, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 08:15:47,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 250ms, sequenceid=131, compaction requested=false 2023-07-14 08:15:47,642 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 08:15:47,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:47,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 08:15:47,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 08:15:47,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 08:15:47,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 08:15:47,712 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:47,712 INFO [RS:0;jenkins-hbase9:44465] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44465,1689322343497; zookeeper connection closed. 2023-07-14 08:15:47,712 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:44465-0x10162d605320001, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:47,712 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@24560aa9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@24560aa9 2023-07-14 08:15:47,713 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44465,1689322343497 already deleted, retry=false 2023-07-14 08:15:47,713 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44465,1689322343497 expired; onlineServers=1 2023-07-14 08:15:47,771 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39739,1689322343570; all regions closed. 2023-07-14 08:15:47,779 DEBUG [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs 2023-07-14 08:15:47,779 INFO [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39739%2C1689322343570.meta:.meta(num 1689322346317) 2023-07-14 08:15:47,788 DEBUG [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/oldWALs 2023-07-14 08:15:47,789 INFO [RS:1;jenkins-hbase9:39739] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39739%2C1689322343570:(num 1689322346112) 2023-07-14 08:15:47,789 DEBUG [RS:1;jenkins-hbase9:39739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,789 INFO [RS:1;jenkins-hbase9:39739] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:47,789 INFO [RS:1;jenkins-hbase9:39739] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 08:15:47,789 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:47,790 INFO [RS:1;jenkins-hbase9:39739] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39739 2023-07-14 08:15:47,792 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:47,793 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39739,1689322343570 2023-07-14 08:15:47,795 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39739,1689322343570] 2023-07-14 08:15:47,795 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39739,1689322343570; numProcessing=3 2023-07-14 08:15:47,895 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:47,895 INFO [RS:1;jenkins-hbase9:39739] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39739,1689322343570; zookeeper connection closed. 2023-07-14 08:15:47,895 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): regionserver:39739-0x10162d605320002, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:47,896 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42f8da11] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42f8da11 2023-07-14 08:15:47,896 INFO [Listener at jenkins-hbase9.apache.org/36457] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 08:15:47,897 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39739,1689322343570 already deleted, retry=false 2023-07-14 08:15:47,897 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39739,1689322343570 expired; onlineServers=0 2023-07-14 08:15:47,897 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45715,1689322341751' ***** 2023-07-14 08:15:47,897 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 08:15:47,898 DEBUG [M:0;jenkins-hbase9:45715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28432a79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:15:47,898 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45715,1689322341751 2023-07-14 08:15:47,898 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45715,1689322341751; all regions closed. 2023-07-14 08:15:47,898 DEBUG [M:0;jenkins-hbase9:45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:47,898 DEBUG [M:0;jenkins-hbase9:45715] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 08:15:47,898 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 08:15:47,898 DEBUG [M:0;jenkins-hbase9:45715] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 08:15:47,898 INFO [M:0;jenkins-hbase9:45715] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 08:15:47,899 INFO [M:0;jenkins-hbase9:45715] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 08:15:47,899 INFO [M:0;jenkins-hbase9:45715] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 08:15:47,899 DEBUG [M:0;jenkins-hbase9:45715] master.HMaster(1512): Stopping service threads 2023-07-14 08:15:47,899 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689322345588] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689322345588,5,FailOnTimeoutGroup] 2023-07-14 08:15:47,899 INFO [M:0;jenkins-hbase9:45715] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 08:15:47,899 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689322345595] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689322345595,5,FailOnTimeoutGroup] 2023-07-14 08:15:47,899 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 08:15:47,900 ERROR [M:0;jenkins-hbase9:45715] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-14 08:15:47,900 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-27,5,PEWorkerGroup] Thread[HFileArchiver-28,5,PEWorkerGroup] 2023-07-14 08:15:47,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:15:47,900 INFO [M:0;jenkins-hbase9:45715] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 08:15:47,900 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 08:15:47,901 DEBUG [M:0;jenkins-hbase9:45715] zookeeper.ZKUtil(398): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 08:15:47,901 WARN [M:0;jenkins-hbase9:45715] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 08:15:47,901 INFO [M:0;jenkins-hbase9:45715] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 08:15:47,901 INFO [M:0;jenkins-hbase9:45715] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 08:15:47,902 DEBUG [M:0;jenkins-hbase9:45715] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 08:15:47,902 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:47,902 DEBUG [M:0;jenkins-hbase9:45715] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:47,902 DEBUG [M:0;jenkins-hbase9:45715] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 08:15:47,902 DEBUG [M:0;jenkins-hbase9:45715] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:47,903 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.37 KB heapSize=449.62 KB 2023-07-14 08:15:47,932 INFO [M:0;jenkins-hbase9:45715] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.37 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8bfe5896abed4f39a5bfd03e9c49b637 2023-07-14 08:15:47,937 INFO [M:0;jenkins-hbase9:45715] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bfe5896abed4f39a5bfd03e9c49b637 2023-07-14 08:15:47,938 DEBUG [M:0;jenkins-hbase9:45715] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8bfe5896abed4f39a5bfd03e9c49b637 as hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8bfe5896abed4f39a5bfd03e9c49b637 2023-07-14 08:15:47,943 INFO [M:0;jenkins-hbase9:45715] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bfe5896abed4f39a5bfd03e9c49b637 2023-07-14 08:15:47,943 INFO [M:0;jenkins-hbase9:45715] regionserver.HStore(1080): Added hdfs://localhost:45081/user/jenkins/test-data/58470be7-8751-d0fa-fe0c-8b065c167b9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8bfe5896abed4f39a5bfd03e9c49b637, entries=119, sequenceid=899, filesize=28.4 K 2023-07-14 08:15:47,944 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegion(2948): Finished flush of dataSize ~373.37 KB/382332, heapSize ~449.60 KB/460392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=899, compaction requested=false 2023-07-14 08:15:47,947 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:47,947 DEBUG [M:0;jenkins-hbase9:45715] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 08:15:47,950 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:47,950 INFO [M:0;jenkins-hbase9:45715] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 08:15:47,951 INFO [M:0;jenkins-hbase9:45715] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45715 2023-07-14 08:15:47,954 DEBUG [M:0;jenkins-hbase9:45715] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,45715,1689322341751 already deleted, retry=false 2023-07-14 08:15:48,055 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:48,056 INFO [M:0;jenkins-hbase9:45715] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45715,1689322341751; zookeeper connection closed. 2023-07-14 08:15:48,056 DEBUG [Listener at localhost/36375-EventThread] zookeeper.ZKWatcher(600): master:45715-0x10162d605320000, quorum=127.0.0.1:54201, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:48,058 WARN [Listener at jenkins-hbase9.apache.org/36457] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 08:15:48,079 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:48,184 WARN [BP-1531582405-172.31.2.10-1689322336404 heartbeating to localhost/127.0.0.1:45081] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 08:15:48,185 WARN [BP-1531582405-172.31.2.10-1689322336404 heartbeating to localhost/127.0.0.1:45081] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1531582405-172.31.2.10-1689322336404 (Datanode Uuid 2cc9ee7d-057c-43a2-a296-580ad21cef4c) service to localhost/127.0.0.1:45081 2023-07-14 08:15:48,187 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data5/current/BP-1531582405-172.31.2.10-1689322336404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:48,188 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data6/current/BP-1531582405-172.31.2.10-1689322336404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:48,191 WARN [Listener at jenkins-hbase9.apache.org/36457] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 08:15:48,200 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:48,306 WARN [BP-1531582405-172.31.2.10-1689322336404 heartbeating to localhost/127.0.0.1:45081] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 08:15:48,306 WARN [BP-1531582405-172.31.2.10-1689322336404 heartbeating to localhost/127.0.0.1:45081] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1531582405-172.31.2.10-1689322336404 (Datanode Uuid 49050c42-79cc-44a7-a859-3195456f1d31) service to localhost/127.0.0.1:45081 2023-07-14 08:15:48,307 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data3/current/BP-1531582405-172.31.2.10-1689322336404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:48,308 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data4/current/BP-1531582405-172.31.2.10-1689322336404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:48,309 WARN [Listener at jenkins-hbase9.apache.org/36457] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 08:15:48,313 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:48,417 WARN [BP-1531582405-172.31.2.10-1689322336404 heartbeating to localhost/127.0.0.1:45081] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 08:15:48,417 WARN [BP-1531582405-172.31.2.10-1689322336404 heartbeating to localhost/127.0.0.1:45081] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1531582405-172.31.2.10-1689322336404 (Datanode Uuid d805f4a2-21a8-4634-8de6-f32003f46355) service to localhost/127.0.0.1:45081 2023-07-14 08:15:48,418 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data1/current/BP-1531582405-172.31.2.10-1689322336404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:48,418 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/639f2dff-6e12-9bb6-52de-1dff835870c4/cluster_beb0e2be-a071-a12c-525b-b24ea0a6e70f/dfs/data/data2/current/BP-1531582405-172.31.2.10-1689322336404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:48,442 INFO [Listener at jenkins-hbase9.apache.org/36457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:48,572 INFO [Listener at jenkins-hbase9.apache.org/36457] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 08:15:48,682 INFO [Listener at jenkins-hbase9.apache.org/36457] hbase.HBaseTestingUtility(1293): Minicluster is down