2023-09-22 10:00:24,335 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-22 10:00:24,511 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3 2023-09-22 10:00:24,512 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-22 10:00:24,512 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-22 10:00:24,550 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-22 10:00:24,772 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-22 10:00:24,772 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4, deleteOnExit=true 2023-09-22 10:00:24,773 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-22 10:00:24,773 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/test.cache.data in system properties and HBase conf 2023-09-22 10:00:24,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop.tmp.dir in system properties and HBase conf 2023-09-22 10:00:24,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop.log.dir in system properties and HBase conf 2023-09-22 10:00:24,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-22 10:00:24,775 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-22 10:00:24,775 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-22 10:00:25,053 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-22 10:00:25,058 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-22 10:00:25,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-22 10:00:25,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-22 10:00:25,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 10:00:25,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-22 10:00:25,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-22 10:00:25,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 10:00:25,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 10:00:25,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-22 10:00:25,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/nfs.dump.dir in system properties and HBase conf 2023-09-22 10:00:25,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir in system properties and HBase conf 2023-09-22 10:00:25,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 10:00:25,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-22 10:00:25,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-22 10:00:25,557 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-22 10:00:25,561 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-22 10:00:25,835 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-22 10:00:25,994 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-22 10:00:26,006 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:26,038 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:26,069 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_localhost_40669_hdfs____3whcmf/webapp 2023-09-22 10:00:26,187 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40669 2023-09-22 10:00:26,197 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-22 10:00:26,197 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-22 10:00:26,637 WARN [Listener at localhost/39103] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 10:00:26,707 WARN [Listener at localhost/39103] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 10:00:26,736 WARN [Listener at localhost/39103] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:26,746 INFO [Listener at localhost/39103] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:26,755 INFO [Listener at localhost/39103] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_localhost_42993_datanode____.b84ekk/webapp 2023-09-22 10:00:26,885 INFO [Listener at localhost/39103] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42993 2023-09-22 10:00:27,270 WARN [Listener at localhost/44957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 10:00:27,285 WARN [Listener at localhost/44957] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 10:00:27,289 WARN [Listener at localhost/44957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:27,291 INFO [Listener at localhost/44957] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:27,304 INFO [Listener at localhost/44957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_localhost_38317_datanode____qpmjnf/webapp 2023-09-22 10:00:27,413 INFO [Listener at localhost/44957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38317 2023-09-22 10:00:27,424 WARN [Listener at localhost/37165] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 10:00:27,440 WARN [Listener at localhost/37165] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 10:00:27,445 WARN [Listener at localhost/37165] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:27,446 INFO [Listener at localhost/37165] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:27,453 INFO [Listener at localhost/37165] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_localhost_41277_datanode____x3izbw/webapp 2023-09-22 10:00:27,548 INFO [Listener at localhost/37165] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41277 2023-09-22 10:00:27,561 WARN [Listener at localhost/46713] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 10:00:27,784 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0fa02277f163ef4: Processing first storage report for DS-50e55583-fed3-46ef-9054-95a453eefedf from datanode 4ab6fb28-339f-48a7-a4cc-caa0ffacb7c0 2023-09-22 10:00:27,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0fa02277f163ef4: from storage DS-50e55583-fed3-46ef-9054-95a453eefedf node DatanodeRegistration(127.0.0.1:38047, datanodeUuid=4ab6fb28-339f-48a7-a4cc-caa0ffacb7c0, infoPort=43293, infoSecurePort=0, ipcPort=44957, storageInfo=lv=-57;cid=testClusterID;nsid=112800984;c=1695376825633), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-22 10:00:27,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x68a0aab2856d0cea: Processing first storage report for DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10 from datanode c7d42629-00c4-4538-9e2f-53ee4f01d075 2023-09-22 10:00:27,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x68a0aab2856d0cea: from storage DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10 node DatanodeRegistration(127.0.0.1:41297, datanodeUuid=c7d42629-00c4-4538-9e2f-53ee4f01d075, infoPort=35181, infoSecurePort=0, ipcPort=46713, storageInfo=lv=-57;cid=testClusterID;nsid=112800984;c=1695376825633), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 10:00:27,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe0e406a29c946bf8: Processing first storage report for DS-18c94c07-9828-4b29-ad84-8abc82a1b715 from datanode 068fa58a-a51a-40fa-87d1-25f30e7c6c74 2023-09-22 10:00:27,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe0e406a29c946bf8: from storage DS-18c94c07-9828-4b29-ad84-8abc82a1b715 node DatanodeRegistration(127.0.0.1:37229, datanodeUuid=068fa58a-a51a-40fa-87d1-25f30e7c6c74, infoPort=32981, infoSecurePort=0, ipcPort=37165, storageInfo=lv=-57;cid=testClusterID;nsid=112800984;c=1695376825633), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 10:00:27,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0fa02277f163ef4: Processing first storage report for DS-e1ee0531-8855-4a77-9cd3-f200e61640d8 from datanode 4ab6fb28-339f-48a7-a4cc-caa0ffacb7c0 2023-09-22 10:00:27,787 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0fa02277f163ef4: from storage DS-e1ee0531-8855-4a77-9cd3-f200e61640d8 node DatanodeRegistration(127.0.0.1:38047, datanodeUuid=4ab6fb28-339f-48a7-a4cc-caa0ffacb7c0, infoPort=43293, infoSecurePort=0, ipcPort=44957, storageInfo=lv=-57;cid=testClusterID;nsid=112800984;c=1695376825633), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 10:00:27,787 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x68a0aab2856d0cea: Processing first storage report for DS-10d51453-6525-42ab-9286-e630b97de6cc from datanode c7d42629-00c4-4538-9e2f-53ee4f01d075 2023-09-22 10:00:27,787 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x68a0aab2856d0cea: from storage DS-10d51453-6525-42ab-9286-e630b97de6cc node DatanodeRegistration(127.0.0.1:41297, datanodeUuid=c7d42629-00c4-4538-9e2f-53ee4f01d075, infoPort=35181, infoSecurePort=0, ipcPort=46713, storageInfo=lv=-57;cid=testClusterID;nsid=112800984;c=1695376825633), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 10:00:27,787 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe0e406a29c946bf8: Processing first storage report for DS-30daed97-3d97-409f-9e93-612c14802efe from datanode 068fa58a-a51a-40fa-87d1-25f30e7c6c74 2023-09-22 10:00:27,787 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe0e406a29c946bf8: from storage DS-30daed97-3d97-409f-9e93-612c14802efe node DatanodeRegistration(127.0.0.1:37229, datanodeUuid=068fa58a-a51a-40fa-87d1-25f30e7c6c74, infoPort=32981, infoSecurePort=0, ipcPort=37165, storageInfo=lv=-57;cid=testClusterID;nsid=112800984;c=1695376825633), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 10:00:28,002 DEBUG [Listener at localhost/46713] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3 2023-09-22 10:00:28,104 INFO [Listener at localhost/46713] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/zookeeper_0, clientPort=49896, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-22 10:00:28,127 INFO [Listener at localhost/46713] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49896 2023-09-22 10:00:28,137 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:28,139 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:28,800 INFO [Listener at localhost/46713] util.FSUtils(471): Created version file at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b with version=8 2023-09-22 10:00:28,800 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/hbase-staging 2023-09-22 10:00:29,104 INFO [Listener at localhost/46713] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-22 10:00:29,477 INFO [Listener at localhost/46713] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-09-22 10:00:29,504 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:29,504 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:29,505 INFO [Listener at localhost/46713] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 10:00:29,505 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:29,505 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 10:00:29,626 INFO [Listener at localhost/46713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 10:00:29,697 DEBUG [Listener at localhost/46713] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-22 10:00:29,782 INFO [Listener at localhost/46713] ipc.NettyRpcServer(120): Bind to /136.243.18.41:45161 2023-09-22 10:00:29,793 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:29,795 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:29,818 INFO [Listener at localhost/46713] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45161 connecting to ZooKeeper ensemble=127.0.0.1:49896 2023-09-22 10:00:29,876 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:451610x0, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 10:00:29,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45161-0x100d313a1f70000 connected 2023-09-22 10:00:29,911 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 10:00:29,912 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:00:29,923 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 10:00:29,930 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45161 2023-09-22 10:00:29,931 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45161 2023-09-22 10:00:29,931 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45161 2023-09-22 10:00:29,932 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45161 2023-09-22 10:00:29,932 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45161 2023-09-22 10:00:29,938 INFO [Listener at localhost/46713] master.HMaster(444): hbase.rootdir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, hbase.cluster.distributed=false 2023-09-22 10:00:29,997 INFO [Listener at localhost/46713] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-22 10:00:29,997 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:29,998 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:29,998 INFO [Listener at localhost/46713] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 10:00:29,998 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:29,998 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 10:00:30,002 INFO [Listener at localhost/46713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 10:00:30,006 INFO [Listener at localhost/46713] ipc.NettyRpcServer(120): Bind to /136.243.18.41:41167 2023-09-22 10:00:30,008 INFO [Listener at localhost/46713] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 10:00:30,015 INFO [Listener at localhost/46713] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 10:00:30,016 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,018 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,021 INFO [Listener at localhost/46713] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41167 connecting to ZooKeeper ensemble=127.0.0.1:49896 2023-09-22 10:00:30,025 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:411670x0, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 10:00:30,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41167-0x100d313a1f70001 connected 2023-09-22 10:00:30,027 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 10:00:30,028 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:00:30,029 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 10:00:30,031 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41167 2023-09-22 10:00:30,031 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41167 2023-09-22 10:00:30,032 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41167 2023-09-22 10:00:30,033 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41167 2023-09-22 10:00:30,033 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41167 2023-09-22 10:00:30,043 INFO [Listener at localhost/46713] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-22 10:00:30,044 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:30,044 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:30,044 INFO [Listener at localhost/46713] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 10:00:30,044 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:30,044 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 10:00:30,045 INFO [Listener at localhost/46713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 10:00:30,048 INFO [Listener at localhost/46713] ipc.NettyRpcServer(120): Bind to /136.243.18.41:32793 2023-09-22 10:00:30,049 INFO [Listener at localhost/46713] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 10:00:30,051 INFO [Listener at localhost/46713] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 10:00:30,052 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,054 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,057 INFO [Listener at localhost/46713] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32793 connecting to ZooKeeper ensemble=127.0.0.1:49896 2023-09-22 10:00:30,064 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:327930x0, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 10:00:30,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32793-0x100d313a1f70002 connected 2023-09-22 10:00:30,065 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 10:00:30,066 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:00:30,067 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 10:00:30,068 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32793 2023-09-22 10:00:30,069 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32793 2023-09-22 10:00:30,070 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32793 2023-09-22 10:00:30,077 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32793 2023-09-22 10:00:30,077 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32793 2023-09-22 10:00:30,089 INFO [Listener at localhost/46713] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-22 10:00:30,089 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:30,089 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:30,090 INFO [Listener at localhost/46713] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 10:00:30,090 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 10:00:30,090 INFO [Listener at localhost/46713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 10:00:30,090 INFO [Listener at localhost/46713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 10:00:30,091 INFO [Listener at localhost/46713] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44903 2023-09-22 10:00:30,092 INFO [Listener at localhost/46713] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 10:00:30,092 INFO [Listener at localhost/46713] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 10:00:30,093 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,095 INFO [Listener at localhost/46713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,096 INFO [Listener at localhost/46713] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44903 connecting to ZooKeeper ensemble=127.0.0.1:49896 2023-09-22 10:00:30,099 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:449030x0, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 10:00:30,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44903-0x100d313a1f70003 connected 2023-09-22 10:00:30,101 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 10:00:30,102 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:00:30,103 DEBUG [Listener at localhost/46713] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 10:00:30,103 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44903 2023-09-22 10:00:30,103 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44903 2023-09-22 10:00:30,104 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44903 2023-09-22 10:00:30,104 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44903 2023-09-22 10:00:30,105 DEBUG [Listener at localhost/46713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44903 2023-09-22 10:00:30,109 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:30,117 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-22 10:00:30,119 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:30,137 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 10:00:30,137 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 10:00:30,137 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 10:00:30,137 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 10:00:30,137 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:30,139 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-22 10:00:30,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-22 10:00:30,140 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,45161,1695376828936 from backup master directory 2023-09-22 10:00:30,144 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:30,144 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-22 10:00:30,144 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 10:00:30,145 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:30,147 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-22 10:00:30,149 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-22 10:00:30,239 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/hbase.id with ID: 9a452cfa-049a-433d-8277-ff5d8d43a11d 2023-09-22 10:00:30,292 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 10:00:30,309 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:30,362 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5b1825c3 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:30,393 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@759b9676, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:30,420 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-22 10:00:30,422 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-22 10:00:30,438 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-22 10:00:30,439 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-22 10:00:30,441 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-22 10:00:30,445 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-22 10:00:30,446 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 10:00:30,479 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store-tmp 2023-09-22 10:00:30,518 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:30,518 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-22 10:00:30,519 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:00:30,519 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:00:30,519 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-22 10:00:30,519 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:00:30,519 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:00:30,519 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 10:00:30,521 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/WALs/jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:30,549 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C45161%2C1695376828936, suffix=, logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/WALs/jenkins-hbase17.apache.org,45161,1695376828936, archiveDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/oldWALs, maxLogs=10 2023-09-22 10:00:30,606 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK] 2023-09-22 10:00:30,606 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK] 2023-09-22 10:00:30,606 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK] 2023-09-22 10:00:30,614 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-22 10:00:30,677 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/WALs/jenkins-hbase17.apache.org,45161,1695376828936/jenkins-hbase17.apache.org%2C45161%2C1695376828936.1695376830561 2023-09-22 10:00:30,677 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK], DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK], DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK]] 2023-09-22 10:00:30,678 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-22 10:00:30,678 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:30,681 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 10:00:30,682 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 10:00:30,742 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-22 10:00:30,750 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-22 10:00:30,781 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-22 10:00:30,793 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:30,799 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-22 10:00:30,800 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-22 10:00:30,815 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 10:00:30,819 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:30,820 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71769159, jitterRate=0.06944380700588226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:30,820 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 10:00:30,821 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-22 10:00:30,841 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-22 10:00:30,841 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-22 10:00:30,843 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-22 10:00:30,845 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-22 10:00:30,875 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 29 msec 2023-09-22 10:00:30,875 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-22 10:00:30,901 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-22 10:00:30,906 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-22 10:00:30,927 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-22 10:00:30,931 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-22 10:00:30,932 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-22 10:00:30,937 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-22 10:00:30,941 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-22 10:00:30,943 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:30,945 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-22 10:00:30,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-22 10:00:30,959 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-22 10:00:30,963 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 10:00:30,963 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 10:00:30,963 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 10:00:30,963 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 10:00:30,963 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:30,964 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,45161,1695376828936, sessionid=0x100d313a1f70000, setting cluster-up flag (Was=false) 2023-09-22 10:00:30,983 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:30,987 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-22 10:00:30,988 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:30,993 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:30,997 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-22 10:00:30,999 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:31,001 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp 2023-09-22 10:00:31,015 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(951): ClusterId : 9a452cfa-049a-433d-8277-ff5d8d43a11d 2023-09-22 10:00:31,015 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(951): ClusterId : 9a452cfa-049a-433d-8277-ff5d8d43a11d 2023-09-22 10:00:31,015 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(951): ClusterId : 9a452cfa-049a-433d-8277-ff5d8d43a11d 2023-09-22 10:00:31,023 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 10:00:31,023 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 10:00:31,023 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 10:00:31,029 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 10:00:31,029 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 10:00:31,029 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 10:00:31,029 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 10:00:31,029 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 10:00:31,029 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 10:00:31,032 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 10:00:31,032 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 10:00:31,032 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 10:00:31,036 DEBUG [RS:1;jenkins-hbase17:32793] zookeeper.ReadOnlyZKClient(139): Connect 0x625fb3cc to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:31,036 DEBUG [RS:2;jenkins-hbase17:44903] zookeeper.ReadOnlyZKClient(139): Connect 0x4fa7ac0a to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:31,036 DEBUG [RS:0;jenkins-hbase17:41167] zookeeper.ReadOnlyZKClient(139): Connect 0x309db57c to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:31,046 DEBUG [RS:2;jenkins-hbase17:44903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41604b8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:31,046 DEBUG [RS:1;jenkins-hbase17:32793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c9851f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:31,047 DEBUG [RS:2;jenkins-hbase17:44903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@455fc77a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-22 10:00:31,047 DEBUG [RS:1;jenkins-hbase17:32793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68a7d8bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-22 10:00:31,072 DEBUG [RS:0;jenkins-hbase17:41167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5a5d1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:31,072 DEBUG [RS:0;jenkins-hbase17:41167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a65de0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-22 10:00:31,098 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:44903 2023-09-22 10:00:31,098 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:41167 2023-09-22 10:00:31,099 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:32793 2023-09-22 10:00:31,103 INFO [RS:2;jenkins-hbase17:44903] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 10:00:31,103 INFO [RS:1;jenkins-hbase17:32793] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 10:00:31,104 INFO [RS:1;jenkins-hbase17:32793] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 10:00:31,103 INFO [RS:0;jenkins-hbase17:41167] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 10:00:31,104 INFO [RS:0;jenkins-hbase17:41167] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 10:00:31,104 INFO [RS:2;jenkins-hbase17:44903] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 10:00:31,124 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 10:00:31,124 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 10:00:31,124 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-22 10:00:31,124 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 10:00:31,126 INFO [RS:1;jenkins-hbase17:32793] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:31,126 INFO [RS:0;jenkins-hbase17:41167] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:31,127 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 10:00:31,126 INFO [RS:2;jenkins-hbase17:44903] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:31,127 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 10:00:31,126 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:31,127 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 10:00:31,127 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-22 10:00:31,130 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45161,1695376828936 with isa=jenkins-hbase17.apache.org/136.243.18.41:32793, startcode=1695376830043 2023-09-22 10:00:31,130 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45161,1695376828936 with isa=jenkins-hbase17.apache.org/136.243.18.41:41167, startcode=1695376829996 2023-09-22 10:00:31,130 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45161,1695376828936 with isa=jenkins-hbase17.apache.org/136.243.18.41:44903, startcode=1695376830088 2023-09-22 10:00:31,146 DEBUG [RS:1;jenkins-hbase17:32793] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 10:00:31,146 DEBUG [RS:2;jenkins-hbase17:44903] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 10:00:31,146 DEBUG [RS:0;jenkins-hbase17:41167] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 10:00:31,209 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51355, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 10:00:31,209 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50407, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 10:00:31,209 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55679, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 10:00:31,213 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-22 10:00:31,218 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45161] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-22 10:00:31,225 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-22 10:00:31,226 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-22 10:00:31,226 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45161] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-22 10:00:31,226 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-22 10:00:31,226 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-22 10:00:31,226 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45161] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-22 10:00:31,226 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-09-22 10:00:31,227 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,228 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-22 10:00:31,228 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,230 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695376861230 2023-09-22 10:00:31,234 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-22 10:00:31,237 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-22 10:00:31,238 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-22 10:00:31,243 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 10:00:31,244 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-22 10:00:31,248 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(2830): Master is not running yet 2023-09-22 10:00:31,248 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(2830): Master is not running yet 2023-09-22 10:00:31,248 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(2830): Master is not running yet 2023-09-22 10:00:31,249 WARN [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-22 10:00:31,249 WARN [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-22 10:00:31,249 WARN [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-22 10:00:31,252 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-22 10:00:31,252 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-22 10:00:31,252 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-22 10:00:31,253 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-22 10:00:31,253 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,254 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-22 10:00:31,257 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-22 10:00:31,257 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-22 10:00:31,261 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-22 10:00:31,261 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-22 10:00:31,263 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1695376831263,5,FailOnTimeoutGroup] 2023-09-22 10:00:31,264 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1695376831263,5,FailOnTimeoutGroup] 2023-09-22 10:00:31,264 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,264 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-22 10:00:31,266 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,266 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,286 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-22 10:00:31,287 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-22 10:00:31,287 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:31,310 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:31,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-22 10:00:31,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/info 2023-09-22 10:00:31,316 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-22 10:00:31,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:31,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-22 10:00:31,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/rep_barrier 2023-09-22 10:00:31,320 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-22 10:00:31,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:31,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-22 10:00:31,323 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/table 2023-09-22 10:00:31,324 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-22 10:00:31,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:31,326 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740 2023-09-22 10:00:31,327 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740 2023-09-22 10:00:31,331 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-22 10:00:31,332 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-22 10:00:31,336 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:31,337 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67453736, jitterRate=0.005138993263244629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-22 10:00:31,337 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-22 10:00:31,337 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-22 10:00:31,337 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-22 10:00:31,337 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-22 10:00:31,337 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-22 10:00:31,337 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-22 10:00:31,339 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-22 10:00:31,339 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-22 10:00:31,344 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-22 10:00:31,344 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-22 10:00:31,351 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45161,1695376828936 with isa=jenkins-hbase17.apache.org/136.243.18.41:44903, startcode=1695376830088 2023-09-22 10:00:31,351 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45161,1695376828936 with isa=jenkins-hbase17.apache.org/136.243.18.41:32793, startcode=1695376830043 2023-09-22 10:00:31,351 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45161,1695376828936 with isa=jenkins-hbase17.apache.org/136.243.18.41:41167, startcode=1695376829996 2023-09-22 10:00:31,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-22 10:00:31,358 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45161] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,363 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45161] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,365 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45161] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,365 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:31,365 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:31,365 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39103 2023-09-22 10:00:31,366 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39103 2023-09-22 10:00:31,366 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 10:00:31,366 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 10:00:31,367 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:31,367 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39103 2023-09-22 10:00:31,367 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 10:00:31,372 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:00:31,374 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-22 10:00:31,375 DEBUG [RS:2;jenkins-hbase17:44903] zookeeper.ZKUtil(162): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,375 WARN [RS:2;jenkins-hbase17:44903] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 10:00:31,375 DEBUG [RS:0;jenkins-hbase17:41167] zookeeper.ZKUtil(162): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,375 INFO [RS:2;jenkins-hbase17:44903] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 10:00:31,375 DEBUG [RS:1;jenkins-hbase17:32793] zookeeper.ZKUtil(162): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,375 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,41167,1695376829996] 2023-09-22 10:00:31,376 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,44903,1695376830088] 2023-09-22 10:00:31,376 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,376 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,32793,1695376830043] 2023-09-22 10:00:31,375 WARN [RS:0;jenkins-hbase17:41167] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 10:00:31,375 WARN [RS:1;jenkins-hbase17:32793] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 10:00:31,378 INFO [RS:0;jenkins-hbase17:41167] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 10:00:31,378 INFO [RS:1;jenkins-hbase17:32793] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 10:00:31,379 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,379 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,379 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-22 10:00:31,397 DEBUG [RS:0;jenkins-hbase17:41167] zookeeper.ZKUtil(162): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,397 DEBUG [RS:1;jenkins-hbase17:32793] zookeeper.ZKUtil(162): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,397 DEBUG [RS:2;jenkins-hbase17:44903] zookeeper.ZKUtil(162): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,397 DEBUG [RS:0;jenkins-hbase17:41167] zookeeper.ZKUtil(162): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,397 DEBUG [RS:1;jenkins-hbase17:32793] zookeeper.ZKUtil(162): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,397 DEBUG [RS:2;jenkins-hbase17:44903] zookeeper.ZKUtil(162): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,397 DEBUG [RS:0;jenkins-hbase17:41167] zookeeper.ZKUtil(162): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,398 DEBUG [RS:1;jenkins-hbase17:32793] zookeeper.ZKUtil(162): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,398 DEBUG [RS:2;jenkins-hbase17:44903] zookeeper.ZKUtil(162): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,411 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 10:00:31,411 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 10:00:31,411 DEBUG [RS:2;jenkins-hbase17:44903] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 10:00:31,421 INFO [RS:2;jenkins-hbase17:44903] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 10:00:31,422 INFO [RS:0;jenkins-hbase17:41167] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 10:00:31,421 INFO [RS:1;jenkins-hbase17:32793] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 10:00:31,447 INFO [RS:0;jenkins-hbase17:41167] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 10:00:31,447 INFO [RS:2;jenkins-hbase17:44903] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 10:00:31,447 INFO [RS:1;jenkins-hbase17:32793] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 10:00:31,452 INFO [RS:0;jenkins-hbase17:41167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 10:00:31,452 INFO [RS:1;jenkins-hbase17:32793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 10:00:31,452 INFO [RS:2;jenkins-hbase17:44903] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 10:00:31,453 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,452 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,453 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,454 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 10:00:31,454 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 10:00:31,455 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 10:00:31,462 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,462 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,462 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,463 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,463 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,463 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,463 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-22 10:00:31,464 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,464 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-22 10:00:31,465 DEBUG [RS:0;jenkins-hbase17:41167] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-22 10:00:31,465 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,465 DEBUG [RS:1;jenkins-hbase17:32793] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,466 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,466 DEBUG [RS:2;jenkins-hbase17:44903] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-22 10:00:31,470 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,470 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,471 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,494 INFO [RS:2;jenkins-hbase17:44903] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 10:00:31,494 INFO [RS:0;jenkins-hbase17:41167] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 10:00:31,494 INFO [RS:1;jenkins-hbase17:32793] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 10:00:31,499 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41167,1695376829996-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,499 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,32793,1695376830043-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,499 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44903,1695376830088-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:31,520 INFO [RS:2;jenkins-hbase17:44903] regionserver.Replication(203): jenkins-hbase17.apache.org,44903,1695376830088 started 2023-09-22 10:00:31,520 INFO [RS:0;jenkins-hbase17:41167] regionserver.Replication(203): jenkins-hbase17.apache.org,41167,1695376829996 started 2023-09-22 10:00:31,520 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,44903,1695376830088, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:44903, sessionid=0x100d313a1f70003 2023-09-22 10:00:31,520 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,41167,1695376829996, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:41167, sessionid=0x100d313a1f70001 2023-09-22 10:00:31,521 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 10:00:31,521 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 10:00:31,521 DEBUG [RS:0;jenkins-hbase17:41167] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,521 DEBUG [RS:2;jenkins-hbase17:44903] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,521 DEBUG [RS:0;jenkins-hbase17:41167] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,41167,1695376829996' 2023-09-22 10:00:31,521 DEBUG [RS:2;jenkins-hbase17:44903] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44903,1695376830088' 2023-09-22 10:00:31,521 DEBUG [RS:2;jenkins-hbase17:44903] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 10:00:31,521 DEBUG [RS:0;jenkins-hbase17:41167] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 10:00:31,522 DEBUG [RS:2;jenkins-hbase17:44903] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 10:00:31,522 DEBUG [RS:0;jenkins-hbase17:41167] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 10:00:31,522 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 10:00:31,523 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 10:00:31,523 DEBUG [RS:2;jenkins-hbase17:44903] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:31,523 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 10:00:31,523 DEBUG [RS:2;jenkins-hbase17:44903] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44903,1695376830088' 2023-09-22 10:00:31,523 DEBUG [RS:2;jenkins-hbase17:44903] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:31,523 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 10:00:31,523 DEBUG [RS:0;jenkins-hbase17:41167] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,523 DEBUG [RS:0;jenkins-hbase17:41167] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,41167,1695376829996' 2023-09-22 10:00:31,523 DEBUG [RS:0;jenkins-hbase17:41167] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:31,523 INFO [RS:1;jenkins-hbase17:32793] regionserver.Replication(203): jenkins-hbase17.apache.org,32793,1695376830043 started 2023-09-22 10:00:31,523 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,32793,1695376830043, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:32793, sessionid=0x100d313a1f70002 2023-09-22 10:00:31,524 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 10:00:31,524 DEBUG [RS:1;jenkins-hbase17:32793] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,524 DEBUG [RS:1;jenkins-hbase17:32793] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,32793,1695376830043' 2023-09-22 10:00:31,524 DEBUG [RS:1;jenkins-hbase17:32793] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 10:00:31,524 DEBUG [RS:0;jenkins-hbase17:41167] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:31,524 DEBUG [RS:2;jenkins-hbase17:44903] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:31,524 DEBUG [RS:1;jenkins-hbase17:32793] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 10:00:31,525 DEBUG [RS:0;jenkins-hbase17:41167] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 10:00:31,525 DEBUG [RS:2;jenkins-hbase17:44903] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 10:00:31,525 INFO [RS:0;jenkins-hbase17:41167] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 10:00:31,525 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 10:00:31,525 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 10:00:31,525 DEBUG [RS:1;jenkins-hbase17:32793] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:31,525 DEBUG [RS:1;jenkins-hbase17:32793] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,32793,1695376830043' 2023-09-22 10:00:31,525 DEBUG [RS:1;jenkins-hbase17:32793] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:31,525 INFO [RS:2;jenkins-hbase17:44903] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 10:00:31,525 INFO [RS:2;jenkins-hbase17:44903] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 10:00:31,525 INFO [RS:0;jenkins-hbase17:41167] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 10:00:31,526 DEBUG [RS:1;jenkins-hbase17:32793] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:31,526 DEBUG [RS:1;jenkins-hbase17:32793] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 10:00:31,526 INFO [RS:1;jenkins-hbase17:32793] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 10:00:31,526 INFO [RS:1;jenkins-hbase17:32793] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 10:00:31,532 DEBUG [jenkins-hbase17:45161] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-22 10:00:31,536 DEBUG [jenkins-hbase17:45161] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:00:31,542 DEBUG [jenkins-hbase17:45161] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:00:31,542 DEBUG [jenkins-hbase17:45161] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:00:31,542 DEBUG [jenkins-hbase17:45161] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:00:31,542 DEBUG [jenkins-hbase17:45161] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:00:31,545 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,41167,1695376829996, state=OPENING 2023-09-22 10:00:31,554 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-22 10:00:31,555 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:31,556 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-22 10:00:31,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,41167,1695376829996}] 2023-09-22 10:00:31,638 INFO [RS:1;jenkins-hbase17:32793] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C32793%2C1695376830043, suffix=, logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,32793,1695376830043, archiveDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs, maxLogs=32 2023-09-22 10:00:31,638 INFO [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41167%2C1695376829996, suffix=, logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,41167,1695376829996, archiveDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs, maxLogs=32 2023-09-22 10:00:31,639 INFO [RS:2;jenkins-hbase17:44903] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44903%2C1695376830088, suffix=, logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,44903,1695376830088, archiveDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs, maxLogs=32 2023-09-22 10:00:31,663 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK] 2023-09-22 10:00:31,664 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK] 2023-09-22 10:00:31,671 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK] 2023-09-22 10:00:31,672 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK] 2023-09-22 10:00:31,672 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK] 2023-09-22 10:00:31,672 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK] 2023-09-22 10:00:31,673 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK] 2023-09-22 10:00:31,673 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK] 2023-09-22 10:00:31,674 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK] 2023-09-22 10:00:31,686 INFO [RS:1;jenkins-hbase17:32793] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,32793,1695376830043/jenkins-hbase17.apache.org%2C32793%2C1695376830043.1695376831645 2023-09-22 10:00:31,687 DEBUG [RS:1;jenkins-hbase17:32793] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK], DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK], DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK]] 2023-09-22 10:00:31,688 INFO [RS:2;jenkins-hbase17:44903] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,44903,1695376830088/jenkins-hbase17.apache.org%2C44903%2C1695376830088.1695376831645 2023-09-22 10:00:31,688 INFO [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,41167,1695376829996/jenkins-hbase17.apache.org%2C41167%2C1695376829996.1695376831645 2023-09-22 10:00:31,688 DEBUG [RS:2;jenkins-hbase17:44903] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK], DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK], DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK]] 2023-09-22 10:00:31,688 DEBUG [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK], DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK], DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK]] 2023-09-22 10:00:31,747 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:31,749 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 10:00:31,752 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 10:00:31,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-22 10:00:31,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 10:00:31,772 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41167%2C1695376829996.meta, suffix=.meta, logDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,41167,1695376829996, archiveDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs, maxLogs=32 2023-09-22 10:00:31,792 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK] 2023-09-22 10:00:31,792 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK] 2023-09-22 10:00:31,794 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK] 2023-09-22 10:00:31,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/WALs/jenkins-hbase17.apache.org,41167,1695376829996/jenkins-hbase17.apache.org%2C41167%2C1695376829996.meta.1695376831773.meta 2023-09-22 10:00:31,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37229,DS-18c94c07-9828-4b29-ad84-8abc82a1b715,DISK], DatanodeInfoWithStorage[127.0.0.1:38047,DS-50e55583-fed3-46ef-9054-95a453eefedf,DISK], DatanodeInfoWithStorage[127.0.0.1:41297,DS-4612f70d-1bc2-458f-bc0b-42a42e7a1f10,DISK]] 2023-09-22 10:00:31,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-22 10:00:31,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-22 10:00:31,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:31,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-22 10:00:31,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-22 10:00:31,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-22 10:00:31,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-22 10:00:31,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:31,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-22 10:00:31,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-22 10:00:31,829 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-22 10:00:31,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/info 2023-09-22 10:00:31,832 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/info 2023-09-22 10:00:31,832 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-22 10:00:31,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:31,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-22 10:00:31,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/rep_barrier 2023-09-22 10:00:31,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/rep_barrier 2023-09-22 10:00:31,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-22 10:00:31,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:31,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-22 10:00:31,839 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/table 2023-09-22 10:00:31,839 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/table 2023-09-22 10:00:31,839 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-22 10:00:31,840 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:31,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740 2023-09-22 10:00:31,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740 2023-09-22 10:00:31,849 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-22 10:00:31,852 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-22 10:00:31,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59010262, jitterRate=-0.12067857384681702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-22 10:00:31,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-22 10:00:31,869 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695376831739 2023-09-22 10:00:31,887 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-22 10:00:31,888 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-22 10:00:31,888 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,41167,1695376829996, state=OPEN 2023-09-22 10:00:31,891 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-22 10:00:31,891 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-22 10:00:31,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-22 10:00:31,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,41167,1695376829996 in 332 msec 2023-09-22 10:00:31,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-22 10:00:31,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-09-22 10:00:31,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 770 msec 2023-09-22 10:00:31,907 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695376831907, completionTime=-1 2023-09-22 10:00:31,907 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-22 10:00:31,907 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-22 10:00:31,973 DEBUG [hconnection-0x5a910faf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:31,976 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:31,995 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-22 10:00:31,995 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695376891995 2023-09-22 10:00:31,995 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695376951995 2023-09-22 10:00:31,995 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 87 msec 2023-09-22 10:00:32,020 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45161,1695376828936-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:32,020 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45161,1695376828936-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:32,022 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45161,1695376828936-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:32,027 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:45161, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:32,028 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-22 10:00:32,036 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-22 10:00:32,044 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-22 10:00:32,045 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 10:00:32,054 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-22 10:00:32,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:00:32,061 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:00:32,085 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8 empty. 2023-09-22 10:00:32,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,089 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-22 10:00:32,134 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-22 10:00:32,136 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0050752c68fd2dfe558e13d2c289a2a8, NAME => 'hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:00:32,158 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:32,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0050752c68fd2dfe558e13d2c289a2a8, disabling compactions & flushes 2023-09-22 10:00:32,159 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. after waiting 0 ms 2023-09-22 10:00:32,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,159 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0050752c68fd2dfe558e13d2c289a2a8: 2023-09-22 10:00:32,163 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:00:32,177 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695376832167"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376832167"}]},"ts":"1695376832167"} 2023-09-22 10:00:32,204 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-22 10:00:32,206 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:00:32,210 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376832206"}]},"ts":"1695376832206"} 2023-09-22 10:00:32,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-22 10:00:32,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:00:32,221 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:00:32,221 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:00:32,221 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:00:32,221 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:00:32,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0050752c68fd2dfe558e13d2c289a2a8, ASSIGN}] 2023-09-22 10:00:32,227 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0050752c68fd2dfe558e13d2c289a2a8, ASSIGN 2023-09-22 10:00:32,229 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0050752c68fd2dfe558e13d2c289a2a8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:00:32,381 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 10:00:32,382 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0050752c68fd2dfe558e13d2c289a2a8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:32,382 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695376832382"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376832382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376832382"}]},"ts":"1695376832382"} 2023-09-22 10:00:32,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0050752c68fd2dfe558e13d2c289a2a8, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:00:32,542 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:32,544 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 10:00:32,549 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 10:00:32,556 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0050752c68fd2dfe558e13d2c289a2a8, NAME => 'hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.', STARTKEY => '', ENDKEY => ''} 2023-09-22 10:00:32,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. service=AccessControlService 2023-09-22 10:00:32,557 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:32,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:32,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,562 INFO [StoreOpener-0050752c68fd2dfe558e13d2c289a2a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,564 DEBUG [StoreOpener-0050752c68fd2dfe558e13d2c289a2a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/info 2023-09-22 10:00:32,564 DEBUG [StoreOpener-0050752c68fd2dfe558e13d2c289a2a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/info 2023-09-22 10:00:32,565 INFO [StoreOpener-0050752c68fd2dfe558e13d2c289a2a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0050752c68fd2dfe558e13d2c289a2a8 columnFamilyName info 2023-09-22 10:00:32,566 INFO [StoreOpener-0050752c68fd2dfe558e13d2c289a2a8-1] regionserver.HStore(310): Store=0050752c68fd2dfe558e13d2c289a2a8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:32,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,569 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:00:32,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:32,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0050752c68fd2dfe558e13d2c289a2a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73097406, jitterRate=0.08923622965812683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:32,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0050752c68fd2dfe558e13d2c289a2a8: 2023-09-22 10:00:32,581 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8., pid=6, masterSystemTime=1695376832542 2023-09-22 10:00:32,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:00:32,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0050752c68fd2dfe558e13d2c289a2a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:32,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695376832588"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376832588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376832588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376832588"}]},"ts":"1695376832588"} 2023-09-22 10:00:32,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-22 10:00:32,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0050752c68fd2dfe558e13d2c289a2a8, server=jenkins-hbase17.apache.org,32793,1695376830043 in 206 msec 2023-09-22 10:00:32,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-22 10:00:32,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0050752c68fd2dfe558e13d2c289a2a8, ASSIGN in 374 msec 2023-09-22 10:00:32,604 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:00:32,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376832604"}]},"ts":"1695376832604"} 2023-09-22 10:00:32,607 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-22 10:00:32,610 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:00:32,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 564 msec 2023-09-22 10:00:32,656 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-22 10:00:32,658 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-22 10:00:32,658 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:32,678 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:32,682 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:32,695 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-22 10:00:32,714 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-22 10:00:32,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-09-22 10:00:32,729 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-22 10:00:32,741 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-22 10:00:32,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-22 10:00:32,754 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-22 10:00:32,755 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-22 10:00:32,756 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.611sec 2023-09-22 10:00:32,759 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-22 10:00:32,761 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-22 10:00:32,761 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-22 10:00:32,762 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45161,1695376828936-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-22 10:00:32,763 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45161,1695376828936-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-22 10:00:32,781 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 10:00:32,783 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-22 10:00:32,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:00:32,788 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:00:32,791 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:32,791 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-22 10:00:32,792 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58 empty. 2023-09-22 10:00:32,795 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:32,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-22 10:00:32,799 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 10:00:32,820 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-22 10:00:32,822 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 43cfd74c65f8f0a18e3a692d54c55a58, NAME => 'hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:00:32,824 DEBUG [Listener at localhost/46713] zookeeper.ReadOnlyZKClient(139): Connect 0x4f1e3164 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:32,834 DEBUG [Listener at localhost/46713] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5605da95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:32,854 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:32,855 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 43cfd74c65f8f0a18e3a692d54c55a58, disabling compactions & flushes 2023-09-22 10:00:32,855 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:32,855 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:32,855 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. after waiting 0 ms 2023-09-22 10:00:32,855 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:32,855 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:32,856 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 43cfd74c65f8f0a18e3a692d54c55a58: 2023-09-22 10:00:32,861 DEBUG [hconnection-0xf77cc8e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:32,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:00:32,864 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695376832863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376832863"}]},"ts":"1695376832863"} 2023-09-22 10:00:32,867 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-22 10:00:32,869 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:00:32,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376832869"}]},"ts":"1695376832869"} 2023-09-22 10:00:32,873 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-22 10:00:32,875 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:32,877 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:00:32,878 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:00:32,878 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:00:32,878 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:00:32,878 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:00:32,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=43cfd74c65f8f0a18e3a692d54c55a58, ASSIGN}] 2023-09-22 10:00:32,880 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:00:32,880 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-22 10:00:32,880 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/test.cache.data in system properties and HBase conf 2023-09-22 10:00:32,880 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop.tmp.dir in system properties and HBase conf 2023-09-22 10:00:32,880 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop.log.dir in system properties and HBase conf 2023-09-22 10:00:32,881 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-22 10:00:32,881 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-22 10:00:32,881 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-22 10:00:32,881 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-22 10:00:32,881 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=43cfd74c65f8f0a18e3a692d54c55a58, ASSIGN 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 10:00:32,882 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-22 10:00:32,883 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/nfs.dump.dir in system properties and HBase conf 2023-09-22 10:00:32,883 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir in system properties and HBase conf 2023-09-22 10:00:32,883 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 10:00:32,883 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-22 10:00:32,883 INFO [Listener at localhost/46713] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-22 10:00:32,884 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=43cfd74c65f8f0a18e3a692d54c55a58, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41167,1695376829996; forceNewPlan=false, retain=false 2023-09-22 10:00:32,904 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 10:00:33,034 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 10:00:33,036 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=43cfd74c65f8f0a18e3a692d54c55a58, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:33,036 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695376833035"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376833035"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376833035"}]},"ts":"1695376833035"} 2023-09-22 10:00:33,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 43cfd74c65f8f0a18e3a692d54c55a58, server=jenkins-hbase17.apache.org,41167,1695376829996}] 2023-09-22 10:00:33,104 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 10:00:33,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:33,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43cfd74c65f8f0a18e3a692d54c55a58, NAME => 'hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.', STARTKEY => '', ENDKEY => ''} 2023-09-22 10:00:33,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. service=AccessControlService 2023-09-22 10:00:33,201 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:33,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:33,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,204 INFO [StoreOpener-43cfd74c65f8f0a18e3a692d54c55a58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,207 DEBUG [StoreOpener-43cfd74c65f8f0a18e3a692d54c55a58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/l 2023-09-22 10:00:33,207 DEBUG [StoreOpener-43cfd74c65f8f0a18e3a692d54c55a58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/l 2023-09-22 10:00:33,207 INFO [StoreOpener-43cfd74c65f8f0a18e3a692d54c55a58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43cfd74c65f8f0a18e3a692d54c55a58 columnFamilyName l 2023-09-22 10:00:33,208 INFO [StoreOpener-43cfd74c65f8f0a18e3a692d54c55a58-1] regionserver.HStore(310): Store=43cfd74c65f8f0a18e3a692d54c55a58/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:33,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:00:33,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:33,224 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 43cfd74c65f8f0a18e3a692d54c55a58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72536236, jitterRate=0.08087414503097534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:33,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 43cfd74c65f8f0a18e3a692d54c55a58: 2023-09-22 10:00:33,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58., pid=11, masterSystemTime=1695376833194 2023-09-22 10:00:33,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:33,230 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:00:33,231 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=43cfd74c65f8f0a18e3a692d54c55a58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:33,231 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695376833231"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376833231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376833231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376833231"}]},"ts":"1695376833231"} 2023-09-22 10:00:33,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-22 10:00:33,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 43cfd74c65f8f0a18e3a692d54c55a58, server=jenkins-hbase17.apache.org,41167,1695376829996 in 195 msec 2023-09-22 10:00:33,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-22 10:00:33,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=43cfd74c65f8f0a18e3a692d54c55a58, ASSIGN in 371 msec 2023-09-22 10:00:33,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:00:33,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376833256"}]},"ts":"1695376833256"} 2023-09-22 10:00:33,259 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-22 10:00:33,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:00:33,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 480 msec 2023-09-22 10:00:33,404 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 10:00:33,405 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-22 10:00:33,413 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-22 10:00:34,113 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:34,407 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:34,413 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_44349_jobhistory____bvwa4t/webapp 2023-09-22 10:00:34,563 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-22 10:00:34,563 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-22 10:00:34,563 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 10:00:34,566 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 10:00:34,642 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:34,927 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:35,277 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-22 10:00:35,316 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:44349 2023-09-22 10:00:35,610 WARN [Listener at jenkins-hbase17.apache.org/42011] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:35,862 WARN [Listener at jenkins-hbase17.apache.org/42011] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 10:00:35,863 INFO [Listener at jenkins-hbase17.apache.org/42011] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:35,873 INFO [Listener at jenkins-hbase17.apache.org/42011] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_44161_cluster____.qqxkxg/webapp 2023-09-22 10:00:35,938 INFO [Listener at jenkins-hbase17.apache.org/42011] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 10:00:35,938 INFO [Listener at jenkins-hbase17.apache.org/42011] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-22 10:00:35,938 INFO [Listener at jenkins-hbase17.apache.org/42011] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 10:00:35,939 INFO [Listener at jenkins-hbase17.apache.org/42011] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 10:00:35,947 INFO [Listener at jenkins-hbase17.apache.org/42011] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:36,145 INFO [Listener at jenkins-hbase17.apache.org/42011] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:36,268 INFO [Listener at jenkins-hbase17.apache.org/42011] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:36,281 INFO [Listener at jenkins-hbase17.apache.org/42011] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:44161 2023-09-22 10:00:36,712 WARN [Listener at jenkins-hbase17.apache.org/34791] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:36,737 WARN [Listener at jenkins-hbase17.apache.org/34791] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 10:00:36,738 INFO [Listener at jenkins-hbase17.apache.org/34791] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:36,745 INFO [Listener at jenkins-hbase17.apache.org/34791] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_44463_node____.n4w0it/webapp 2023-09-22 10:00:36,788 INFO [Listener at jenkins-hbase17.apache.org/34791] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-22 10:00:36,789 INFO [Listener at jenkins-hbase17.apache.org/34791] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 10:00:36,789 INFO [Listener at jenkins-hbase17.apache.org/34791] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 10:00:36,789 INFO [Listener at jenkins-hbase17.apache.org/34791] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 10:00:36,798 INFO [Listener at jenkins-hbase17.apache.org/34791] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:36,820 INFO [Listener at jenkins-hbase17.apache.org/34791] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:36,923 INFO [Listener at jenkins-hbase17.apache.org/34791] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:36,933 INFO [Listener at jenkins-hbase17.apache.org/34791] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:44463 2023-09-22 10:00:37,103 WARN [Listener at jenkins-hbase17.apache.org/45039] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 10:00:37,109 WARN [Listener at jenkins-hbase17.apache.org/45039] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 10:00:37,110 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 10:00:37,119 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_45115_node____omb6ce/webapp 2023-09-22 10:00:37,163 INFO [Listener at jenkins-hbase17.apache.org/45039] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-22 10:00:37,164 INFO [Listener at jenkins-hbase17.apache.org/45039] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 10:00:37,164 INFO [Listener at jenkins-hbase17.apache.org/45039] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 10:00:37,164 INFO [Listener at jenkins-hbase17.apache.org/45039] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 10:00:37,174 INFO [Listener at jenkins-hbase17.apache.org/45039] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:37,192 INFO [Listener at jenkins-hbase17.apache.org/45039] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:37,291 INFO [Listener at jenkins-hbase17.apache.org/45039] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 10:00:37,298 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:45115 2023-09-22 10:00:37,330 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-22 10:00:37,332 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:00:37,385 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:00:37,400 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=167, AvailableMemoryMB=7678 2023-09-22 10:00:37,403 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-09-22 10:00:37,443 DEBUG [Listener at jenkins-hbase17.apache.org/45039] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-22 10:00:37,453 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-22 10:00:37,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 10:00:37,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:37,475 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:00:37,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-22 10:00:37,482 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:00:37,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 10:00:37,490 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b 2023-09-22 10:00:37,490 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:37,491 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b empty. 2023-09-22 10:00:37,492 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 empty. 2023-09-22 10:00:37,492 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b 2023-09-22 10:00:37,492 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:37,492 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-22 10:00:37,537 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-22 10:00:37,542 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 12e3fc0b5cbc7ec9c891795956ca5146, NAME => 'testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:00:37,542 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => faf07d755401408bbe21d4011339466b, NAME => 'testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:00:37,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 10:00:37,610 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:37,611 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 12e3fc0b5cbc7ec9c891795956ca5146, disabling compactions & flushes 2023-09-22 10:00:37,611 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:37,611 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:37,611 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. after waiting 0 ms 2023-09-22 10:00:37,611 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:37,612 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:37,612 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 12e3fc0b5cbc7ec9c891795956ca5146: 2023-09-22 10:00:37,625 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-22 10:00:37,627 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-22 10:00:37,627 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-22 10:00:37,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 10:00:38,011 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:38,011 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing faf07d755401408bbe21d4011339466b, disabling compactions & flushes 2023-09-22 10:00:38,011 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,011 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,011 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. after waiting 0 ms 2023-09-22 10:00:38,011 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,011 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,011 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for faf07d755401408bbe21d4011339466b: 2023-09-22 10:00:38,016 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:00:38,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376838017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376838017"}]},"ts":"1695376838017"} 2023-09-22 10:00:38,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376838017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376838017"}]},"ts":"1695376838017"} 2023-09-22 10:00:38,066 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:00:38,068 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:00:38,068 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376838068"}]},"ts":"1695376838068"} 2023-09-22 10:00:38,071 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-22 10:00:38,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:00:38,078 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:00:38,078 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:00:38,078 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:00:38,078 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:00:38,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, ASSIGN}] 2023-09-22 10:00:38,082 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, ASSIGN 2023-09-22 10:00:38,082 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, ASSIGN 2023-09-22 10:00:38,083 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41167,1695376829996; forceNewPlan=false, retain=false 2023-09-22 10:00:38,083 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44903,1695376830088; forceNewPlan=false, retain=false 2023-09-22 10:00:38,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 10:00:38,234 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:00:38,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=faf07d755401408bbe21d4011339466b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,236 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=12e3fc0b5cbc7ec9c891795956ca5146, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376838236"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376838236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376838236"}]},"ts":"1695376838236"} 2023-09-22 10:00:38,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376838236"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376838236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376838236"}]},"ts":"1695376838236"} 2023-09-22 10:00:38,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure faf07d755401408bbe21d4011339466b, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:00:38,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 12e3fc0b5cbc7ec9c891795956ca5146, server=jenkins-hbase17.apache.org,41167,1695376829996}] 2023-09-22 10:00:38,393 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,394 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 10:00:38,395 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 10:00:38,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:38,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12e3fc0b5cbc7ec9c891795956ca5146, NAME => 'testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 10:00:38,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => faf07d755401408bbe21d4011339466b, NAME => 'testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. service=AccessControlService 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. service=AccessControlService 2023-09-22 10:00:38,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:38,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:38,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,408 INFO [StoreOpener-faf07d755401408bbe21d4011339466b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,408 INFO [StoreOpener-12e3fc0b5cbc7ec9c891795956ca5146-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,411 DEBUG [StoreOpener-faf07d755401408bbe21d4011339466b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf 2023-09-22 10:00:38,411 DEBUG [StoreOpener-faf07d755401408bbe21d4011339466b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf 2023-09-22 10:00:38,411 DEBUG [StoreOpener-12e3fc0b5cbc7ec9c891795956ca5146-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf 2023-09-22 10:00:38,411 DEBUG [StoreOpener-12e3fc0b5cbc7ec9c891795956ca5146-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf 2023-09-22 10:00:38,415 INFO [StoreOpener-12e3fc0b5cbc7ec9c891795956ca5146-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12e3fc0b5cbc7ec9c891795956ca5146 columnFamilyName cf 2023-09-22 10:00:38,415 INFO [StoreOpener-faf07d755401408bbe21d4011339466b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region faf07d755401408bbe21d4011339466b columnFamilyName cf 2023-09-22 10:00:38,418 INFO [StoreOpener-12e3fc0b5cbc7ec9c891795956ca5146-1] regionserver.HStore(310): Store=12e3fc0b5cbc7ec9c891795956ca5146/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:38,418 INFO [StoreOpener-faf07d755401408bbe21d4011339466b-1] regionserver.HStore(310): Store=faf07d755401408bbe21d4011339466b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:38,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:38,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for faf07d755401408bbe21d4011339466b 2023-09-22 10:00:38,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:38,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:38,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened faf07d755401408bbe21d4011339466b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69298692, jitterRate=0.032630980014801025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:38,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for faf07d755401408bbe21d4011339466b: 2023-09-22 10:00:38,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 12e3fc0b5cbc7ec9c891795956ca5146; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72910256, jitterRate=0.08644747734069824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:38,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 12e3fc0b5cbc7ec9c891795956ca5146: 2023-09-22 10:00:38,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b., pid=15, masterSystemTime=1695376838393 2023-09-22 10:00:38,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146., pid=16, masterSystemTime=1695376838393 2023-09-22 10:00:38,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:38,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:38,447 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=12e3fc0b5cbc7ec9c891795956ca5146, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,447 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376838446"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376838446"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376838446"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376838446"}]},"ts":"1695376838446"} 2023-09-22 10:00:38,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=faf07d755401408bbe21d4011339466b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,451 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376838449"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376838449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376838449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376838449"}]},"ts":"1695376838449"} 2023-09-22 10:00:38,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-22 10:00:38,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 12e3fc0b5cbc7ec9c891795956ca5146, server=jenkins-hbase17.apache.org,41167,1695376829996 in 212 msec 2023-09-22 10:00:38,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-22 10:00:38,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure faf07d755401408bbe21d4011339466b, server=jenkins-hbase17.apache.org,44903,1695376830088 in 217 msec 2023-09-22 10:00:38,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, ASSIGN in 381 msec 2023-09-22 10:00:38,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-22 10:00:38,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, ASSIGN in 386 msec 2023-09-22 10:00:38,472 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:00:38,472 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376838472"}]},"ts":"1695376838472"} 2023-09-22 10:00:38,474 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-22 10:00:38,477 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:00:38,482 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-22 10:00:38,500 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 10:00:38,528 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:38,528 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:38,528 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:38,528 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:38,528 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:00:38,534 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:38,534 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:38,534 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:38,534 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:38,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0670 sec 2023-09-22 10:00:38,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 10:00:38,608 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-22 10:00:38,613 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-22 10:00:38,614 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,616 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:00:38,643 DEBUG [hconnection-0xf77cc8e-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:38,648 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:38,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 10:00:38,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376838666 (current time:1695376838666). 2023-09-22 10:00:38,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:00:38,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x54fcd8e2 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:38,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3979ed4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:38,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:38,680 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:38,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54fcd8e2 to 127.0.0.1:49896 2023-09-22 10:00:38,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:38,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x47b586bf to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:38,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e126e31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:38,694 DEBUG [hconnection-0x426f8bb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:38,698 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:38,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47b586bf to 127.0.0.1:49896 2023-09-22 10:00:38,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:38,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 10:00:38,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:00:38,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 10:00:38,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 10:00:38,747 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 10:00:38,749 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695377438749 2023-09-22 10:00:38,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 10:00:38,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-22 10:00:38,753 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 10:00:38,756 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:00:38,756 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:00:38,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 10:00:38,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-22 10:00:38,760 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 10:00:38,762 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695377438762 2023-09-22 10:00:38,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,794 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-22 10:00:38,794 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:38,796 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-22 10:00:38,796 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-22 10:00:38,797 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,797 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,799 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:38,799 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,799 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:38,799 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:38,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:38,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:38,800 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,800 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,800 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,801 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 10:00:38,803 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 10:00:38,803 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 10:00:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,803 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 10:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,805 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 10:00:38,805 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:38,805 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 10:00:38,805 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 10:00:38,807 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 10:00:38,807 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 10:00:38,807 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:38,807 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 10:00:38,807 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:38,808 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 10:00:38,809 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 10:00:38,809 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 10:00:38,809 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 10:00:38,809 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 10:00:38,809 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 10:00:38,812 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,812 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,812 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:38,813 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:38,813 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:38,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-22 10:00:38,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e5ebf38[Count = 1] remaining members to acquire global barrier 2023-09-22 10:00:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:38,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-22 10:00:38,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e5ebf38[Count = 0] remaining members to acquire global barrier 2023-09-22 10:00:38,818 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-22 10:00:38,818 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 10:00:38,821 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 10:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,821 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:00:38,821 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 10:00:38,821 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,821 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 10:00:38,821 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:00:38,824 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 10:00:38,824 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:38,824 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,824 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:38,824 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:38,824 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:38,824 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 10:00:38,824 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:38,826 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:38,826 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. started... 2023-09-22 10:00:38,826 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. started... 2023-09-22 10:00:38,830 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faf07d755401408bbe21d4011339466b: 2023-09-22 10:00:38,830 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12e3fc0b5cbc7ec9c891795956ca5146: 2023-09-22 10:00:38,831 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,831 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,837 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:38,837 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:38,842 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:00:38,842 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:00:38,857 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:38,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 10:00:38,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:00:38,864 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:00:38,868 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. completed. 2023-09-22 10:00:38,868 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:38,870 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:38,873 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:38,876 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,876 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 10:00:38,876 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:00:38,878 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:38,879 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. completed. 2023-09-22 10:00:38,879 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:38,879 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:38,880 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:38,880 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,880 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 10:00:38,880 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:00:38,881 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 10:00:38,881 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:38,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:38,881 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 10:00:38,882 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 10:00:38,882 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:38,882 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:38,882 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 10:00:38,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,41167,1695376829996': 2023-09-22 10:00:38,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-22 10:00:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:00:38,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-22 10:00:38,894 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-22 10:00:38,894 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:00:38,894 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:00:38,894 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,894 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:00:38,896 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,896 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:38,897 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:38,896 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,897 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:38,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:38,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:38,898 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,898 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:38,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:38,900 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,900 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,900 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,914 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:38,916 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:38,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:38,916 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:38,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:38,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,914 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:38,916 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-22 10:00:38,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:38,916 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:38,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,916 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:38,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:00:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:38,916 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,917 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:38,917 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:38,917 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,917 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:38,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:38,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:38,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 10:00:38,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,996 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-22 10:00:38,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,997 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:38,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695376838749Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695376838938 (+189 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695376838938Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695376838938Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695376838954 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695376838982 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695376838996 (+14 ms) 2023-09-22 10:00:38,999 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 10:00:39,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 248 msec 2023-09-22 10:00:39,064 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:39,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 10:00:39,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:00:39,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:00:39,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41167] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:00:39,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:00:39,084 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-22 10:00:39,085 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:00:39,085 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-22 10:00:39,085 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-22 10:00:39,085 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-22 10:00:39,085 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:00:39,085 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-22 10:00:39,085 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-22 10:00:39,085 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-22 10:00:39,088 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-22 10:00:39,089 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:39,089 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:00:39,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 10:00:39,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376839108 (current time:1695376839108). 2023-09-22 10:00:39,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:00:39,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x7a1a75f8 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:39,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd938c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:39,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:39,119 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:39,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a1a75f8 to 127.0.0.1:49896 2023-09-22 10:00:39,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:39,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x44567a05 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:39,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d4a62c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:39,132 DEBUG [hconnection-0x390100d2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:39,136 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44567a05 to 127.0.0.1:49896 2023-09-22 10:00:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 10:00:39,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:00:39,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 10:00:39,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 10:00:39,150 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 10:00:39,151 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695377439151 2023-09-22 10:00:39,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-22 10:00:39,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 10:00:39,153 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:00:39,153 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:00:39,155 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 10:00:39,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 10:00:39,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-22 10:00:39,158 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 10:00:39,159 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695377439159 2023-09-22 10:00:39,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-22 10:00:39,177 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-22 10:00:39,177 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:39,178 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-22 10:00:39,178 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-22 10:00:39,179 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,179 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,180 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:39,180 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:39,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:39,180 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,180 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:39,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:39,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,181 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,181 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,181 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,182 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:00:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 10:00:39,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 10:00:39,182 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 10:00:39,182 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 10:00:39,182 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:39,182 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:39,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 10:00:39,189 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 10:00:39,190 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 10:00:39,190 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:39,188 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 10:00:39,191 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 10:00:39,191 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 10:00:39,191 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 10:00:39,190 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 10:00:39,191 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 10:00:39,191 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 10:00:39,191 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 10:00:39,193 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,194 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:39,194 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:39,194 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50096369[Count = 1] remaining members to acquire global barrier 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:39,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-22 10:00:39,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50096369[Count = 0] remaining members to acquire global barrier 2023-09-22 10:00:39,198 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-22 10:00:39,198 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 10:00:39,200 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 10:00:39,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,200 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,201 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 10:00:39,201 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 10:00:39,201 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:00:39,201 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,201 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:00:39,202 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:39,204 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:39,204 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:39,204 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:39,204 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:39,204 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. started... 2023-09-22 10:00:39,204 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:39,204 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. started... 2023-09-22 10:00:39,204 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 10:00:39,204 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:39,204 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 10:00:39,204 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing faf07d755401408bbe21d4011339466b 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-22 10:00:39,205 INFO [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 12e3fc0b5cbc7ec9c891795956ca5146 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-22 10:00:39,253 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:39,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 10:00:39,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:00:39,256 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:00:39,356 INFO [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309227894367e46af4037bf4b249e9034ebd2 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309227894367e46af4037bf4b249e9034ebd2 2023-09-22 10:00:39,356 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309229aac69521752494bb34f965fe936a827 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309229aac69521752494bb34f965fe936a827 2023-09-22 10:00:39,389 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/.tmp/cf/ecc7daabbc2148bcbbc795cbe040491d 2023-09-22 10:00:39,390 INFO [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/.tmp/cf/b2ab52d0cda44c988eb06c2e5f94d796 2023-09-22 10:00:39,401 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/.tmp/cf/ecc7daabbc2148bcbbc795cbe040491d as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf/ecc7daabbc2148bcbbc795cbe040491d 2023-09-22 10:00:39,401 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/.tmp/cf/b2ab52d0cda44c988eb06c2e5f94d796 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf/b2ab52d0cda44c988eb06c2e5f94d796 2023-09-22 10:00:39,410 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf/ecc7daabbc2148bcbbc795cbe040491d, entries=3, sequenceid=6, filesize=5.4 K 2023-09-22 10:00:39,410 INFO [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf/b2ab52d0cda44c988eb06c2e5f94d796, entries=47, sequenceid=6, filesize=12.8 K 2023-09-22 10:00:39,416 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for faf07d755401408bbe21d4011339466b in 212ms, sequenceid=6, compaction requested=false 2023-09-22 10:00:39,416 INFO [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 12e3fc0b5cbc7ec9c891795956ca5146 in 212ms, sequenceid=6, compaction requested=false 2023-09-22 10:00:39,416 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-22 10:00:39,416 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-22 10:00:39,419 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12e3fc0b5cbc7ec9c891795956ca5146: 2023-09-22 10:00:39,419 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faf07d755401408bbe21d4011339466b: 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf/b2ab52d0cda44c988eb06c2e5f94d796] hfiles 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf/ecc7daabbc2148bcbbc795cbe040491d] hfiles 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf/b2ab52d0cda44c988eb06c2e5f94d796 for snapshot=snaptb0-testExportWithTargetName 2023-09-22 10:00:39,420 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf/ecc7daabbc2148bcbbc795cbe040491d for snapshot=snaptb0-testExportWithTargetName 2023-09-22 10:00:39,441 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. completed. 2023-09-22 10:00:39,441 DEBUG [rs(jenkins-hbase17.apache.org,41167,1695376829996)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:39,442 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:39,442 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:39,442 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,442 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 10:00:39,442 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:00:39,443 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 10:00:39,443 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,443 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,443 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 10:00:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:39,451 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. completed. 2023-09-22 10:00:39,451 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:39,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:39,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 10:00:39,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:00:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,452 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 10:00:39,452 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:39,452 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,452 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 10:00:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,41167,1695376829996': 2023-09-22 10:00:39,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-22 10:00:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,456 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 10:00:39,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:00:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,458 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-22 10:00:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:00:39,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-22 10:00:39,459 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-22 10:00:39,459 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:00:39,459 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:00:39,459 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-22 10:00:39,459 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,460 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:39,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,461 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:39,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:39,461 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,462 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,464 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,464 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:39,464 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 10:00:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,476 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:39,476 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,476 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:39,477 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,476 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:39,476 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:39,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:39,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:39,477 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:39,477 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-22 10:00:39,477 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:39,477 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-22 10:00:39,477 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:39,477 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:39,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 10:00:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:39,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:00:39,478 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:39,478 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,479 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:39,479 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,479 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:39,479 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:39,479 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,479 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:39,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:39,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:39,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309227894367e46af4037bf4b249e9034ebd2, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309229aac69521752494bb34f965fe936a827] mob files 2023-09-22 10:00:39,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309227894367e46af4037bf4b249e9034ebd2 2023-09-22 10:00:39,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309229aac69521752494bb34f965fe936a827 2023-09-22 10:00:39,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-22 10:00:39,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-22 10:00:39,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,538 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 10:00:39,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695376839151Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695376839497 (+346 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695376839497Loading Region manifests for snaptb0-testExportWithTargetName at 1695376839497Writing data manifest for snaptb0-testExportWithTargetName at 1695376839502 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695376839525 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695376839537 (+12 ms) 2023-09-22 10:00:39,541 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 10:00:39,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 390 msec 2023-09-22 10:00:39,758 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:39,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 10:00:39,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:00:39,761 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761 2023-09-22 10:00:39,762 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39103, tgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761, rawTgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:39,800 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:39,800 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1074370645_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-22 10:00:39,800 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-22 10:00:39,821 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-22 10:00:39,890 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:39,891 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:39,892 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:39,892 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,662 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-2970516631204173165.jar 2023-09-22 10:00:40,663 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,663 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,720 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-5598017170183179114.jar 2023-09-22 10:00:40,720 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,721 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,721 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,722 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,722 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,723 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:40,723 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:00:40,723 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:00:40,724 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:00:40,724 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:00:40,725 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:00:40,725 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:00:40,725 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:00:40,726 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:00:40,726 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:00:40,727 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:00:40,730 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:40,730 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:40,731 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:00:40,731 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:40,732 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:40,732 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:00:40,732 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:00:41,504 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:00:41,510 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-22 10:00:41,520 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-22 10:00:41,920 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:00:41,922 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:00:42,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0001_000001 (auth:SIMPLE) 2023-09-22 10:00:43,913 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:00:46,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0001_000001 (auth:SIMPLE) 2023-09-22 10:00:48,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0001_000001 (auth:SIMPLE) 2023-09-22 10:00:51,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0001_000001 (auth:SIMPLE) 2023-09-22 10:00:53,333 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:00:53,337 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:00:53,348 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-22 10:00:53,348 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:00:53,349 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:00:53,349 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-22 10:00:53,350 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-22 10:00:53,350 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-22 10:00:53,350 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761/.hbase-snapshot/testExportWithTargetName 2023-09-22 10:00:53,351 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-22 10:00:53,351 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376839761/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-22 10:00:53,363 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-22 10:00:53,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-09-22 10:00:53,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,381 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376853381"}]},"ts":"1695376853381"} 2023-09-22 10:00:53,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 10:00:53,384 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-22 10:00:53,385 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-22 10:00:53,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, UNASSIGN}] 2023-09-22 10:00:53,390 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, UNASSIGN 2023-09-22 10:00:53,390 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, UNASSIGN 2023-09-22 10:00:53,392 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=faf07d755401408bbe21d4011339466b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:53,392 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=12e3fc0b5cbc7ec9c891795956ca5146, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:53,392 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376853392"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376853392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376853392"}]},"ts":"1695376853392"} 2023-09-22 10:00:53,392 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376853392"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376853392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376853392"}]},"ts":"1695376853392"} 2023-09-22 10:00:53,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure faf07d755401408bbe21d4011339466b, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:00:53,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 12e3fc0b5cbc7ec9c891795956ca5146, server=jenkins-hbase17.apache.org,41167,1695376829996}] 2023-09-22 10:00:53,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 10:00:53,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:53,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close faf07d755401408bbe21d4011339466b 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 12e3fc0b5cbc7ec9c891795956ca5146, disabling compactions & flushes 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing faf07d755401408bbe21d4011339466b, disabling compactions & flushes 2023-09-22 10:00:53,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. after waiting 0 ms 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:53,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. after waiting 0 ms 2023-09-22 10:00:53,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:53,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:00:53,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:00:53,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:00:53,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:00:53,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b. 2023-09-22 10:00:53,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146. 2023-09-22 10:00:53,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for faf07d755401408bbe21d4011339466b: 2023-09-22 10:00:53,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 12e3fc0b5cbc7ec9c891795956ca5146: 2023-09-22 10:00:53,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:53,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=12e3fc0b5cbc7ec9c891795956ca5146, regionState=CLOSED 2023-09-22 10:00:53,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376853584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376853584"}]},"ts":"1695376853584"} 2023-09-22 10:00:53,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed faf07d755401408bbe21d4011339466b 2023-09-22 10:00:53,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=faf07d755401408bbe21d4011339466b, regionState=CLOSED 2023-09-22 10:00:53,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695376853585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376853585"}]},"ts":"1695376853585"} 2023-09-22 10:00:53,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-22 10:00:53,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 12e3fc0b5cbc7ec9c891795956ca5146, server=jenkins-hbase17.apache.org,41167,1695376829996 in 190 msec 2023-09-22 10:00:53,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-22 10:00:53,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure faf07d755401408bbe21d4011339466b, server=jenkins-hbase17.apache.org,44903,1695376830088 in 192 msec 2023-09-22 10:00:53,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e3fc0b5cbc7ec9c891795956ca5146, UNASSIGN in 202 msec 2023-09-22 10:00:53,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-22 10:00:53,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=faf07d755401408bbe21d4011339466b, UNASSIGN in 203 msec 2023-09-22 10:00:53,593 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376853593"}]},"ts":"1695376853593"} 2023-09-22 10:00:53,595 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-22 10:00:53,601 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-22 10:00:53,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 231 msec 2023-09-22 10:00:53,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 10:00:53,685 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-22 10:00:53,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-09-22 10:00:53,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,698 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-22 10:00:53,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,704 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-22 10:00:53,707 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b 2023-09-22 10:00:53,707 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:53,711 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/recovered.edits] 2023-09-22 10:00:53,711 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/recovered.edits] 2023-09-22 10:00:53,719 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf/b2ab52d0cda44c988eb06c2e5f94d796 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/cf/b2ab52d0cda44c988eb06c2e5f94d796 2023-09-22 10:00:53,719 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf/ecc7daabbc2148bcbbc795cbe040491d to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/cf/ecc7daabbc2148bcbbc795cbe040491d 2023-09-22 10:00:53,724 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b/recovered.edits/9.seqid 2023-09-22 10:00:53,724 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146/recovered.edits/9.seqid 2023-09-22 10:00:53,725 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/faf07d755401408bbe21d4011339466b 2023-09-22 10:00:53,725 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportWithTargetName/12e3fc0b5cbc7ec9c891795956ca5146 2023-09-22 10:00:53,725 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-22 10:00:53,725 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-22 10:00:53,726 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-22 10:00:53,731 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309227894367e46af4037bf4b249e9034ebd2 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309227894367e46af4037bf4b249e9034ebd2 2023-09-22 10:00:53,732 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309229aac69521752494bb34f965fe936a827 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309229aac69521752494bb34f965fe936a827 2023-09-22 10:00:53,733 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-22 10:00:53,736 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,740 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 10:00:53,742 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 10:00:53,742 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 10:00:53,742 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 10:00:53,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-22 10:00:53,744 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-22 10:00:53,744 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 10:00:53,744 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 10:00:53,744 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:53,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 10:00:53,745 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 10:00:53,745 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:53,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 10:00:53,744 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:53,745 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 10:00:53,744 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:53,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-22 10:00:53,759 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-22 10:00:53,762 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-22 10:00:53,764 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,764 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-22 10:00:53,764 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376853764"}]},"ts":"9223372036854775807"} 2023-09-22 10:00:53,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376853764"}]},"ts":"9223372036854775807"} 2023-09-22 10:00:53,767 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 10:00:53,767 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => faf07d755401408bbe21d4011339466b, NAME => 'testtb-testExportWithTargetName,,1695376837467.faf07d755401408bbe21d4011339466b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 12e3fc0b5cbc7ec9c891795956ca5146, NAME => 'testtb-testExportWithTargetName,1,1695376837467.12e3fc0b5cbc7ec9c891795956ca5146.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 10:00:53,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-22 10:00:53,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376853768"}]},"ts":"9223372036854775807"} 2023-09-22 10:00:53,770 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-22 10:00:53,773 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 10:00:53,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 83 msec 2023-09-22 10:00:53,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-22 10:00:53,852 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-22 10:00:53,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-22 10:00:53,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-22 10:00:53,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-09-22 10:00:53,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-22 10:00:53,907 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 708) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:48618 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:45039 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:36993 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:33847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:44828 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:34791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2123700602_1 at /127.0.0.1:48588 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:58504 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 190) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=6947 (was 7678) 2023-09-22 10:00:53,907 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-22 10:00:53,925 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=169, AvailableMemoryMB=6946 2023-09-22 10:00:53,925 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-22 10:00:53,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 10:00:53,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:00:53,933 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:00:53,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-22 10:00:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 10:00:53,936 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:00:53,940 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 2023-09-22 10:00:53,940 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:53,940 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 empty. 2023-09-22 10:00:53,940 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f empty. 2023-09-22 10:00:53,941 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 2023-09-22 10:00:53,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:53,941 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-22 10:00:53,955 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-22 10:00:53,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 917ac3c03433650ffc452e561717d738, NAME => 'testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:00:53,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6766d3c5e0c1d8930ece1a59ec077c5f, NAME => 'testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:00:53,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:53,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 917ac3c03433650ffc452e561717d738, disabling compactions & flushes 2023-09-22 10:00:53,983 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:53,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:53,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. after waiting 0 ms 2023-09-22 10:00:53,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:53,983 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:53,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 917ac3c03433650ffc452e561717d738: 2023-09-22 10:00:53,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:53,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6766d3c5e0c1d8930ece1a59ec077c5f, disabling compactions & flushes 2023-09-22 10:00:53,990 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:53,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:53,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. after waiting 0 ms 2023-09-22 10:00:53,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:53,990 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:53,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6766d3c5e0c1d8930ece1a59ec077c5f: 2023-09-22 10:00:53,994 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:00:53,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376853995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376853995"}]},"ts":"1695376853995"} 2023-09-22 10:00:53,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376853995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376853995"}]},"ts":"1695376853995"} 2023-09-22 10:00:53,998 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:00:53,999 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:00:53,999 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376853999"}]},"ts":"1695376853999"} 2023-09-22 10:00:54,000 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-22 10:00:54,003 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:00:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:00:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:00:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:00:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:00:54,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, ASSIGN}] 2023-09-22 10:00:54,007 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, ASSIGN 2023-09-22 10:00:54,007 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, ASSIGN 2023-09-22 10:00:54,008 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44903,1695376830088; forceNewPlan=false, retain=false 2023-09-22 10:00:54,008 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:00:54,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 10:00:54,159 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:00:54,162 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6766d3c5e0c1d8930ece1a59ec077c5f, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,162 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=917ac3c03433650ffc452e561717d738, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,162 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376854162"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376854162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376854162"}]},"ts":"1695376854162"} 2023-09-22 10:00:54,162 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376854162"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376854162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376854162"}]},"ts":"1695376854162"} 2023-09-22 10:00:54,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6766d3c5e0c1d8930ece1a59ec077c5f, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:00:54,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 917ac3c03433650ffc452e561717d738, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:00:54,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 10:00:54,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 917ac3c03433650ffc452e561717d738, NAME => 'testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6766d3c5e0c1d8930ece1a59ec077c5f, NAME => 'testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. service=AccessControlService 2023-09-22 10:00:54,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. service=AccessControlService 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:00:54,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:00:54,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,328 INFO [StoreOpener-917ac3c03433650ffc452e561717d738-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,328 INFO [StoreOpener-6766d3c5e0c1d8930ece1a59ec077c5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,329 DEBUG [StoreOpener-917ac3c03433650ffc452e561717d738-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf 2023-09-22 10:00:54,329 DEBUG [StoreOpener-6766d3c5e0c1d8930ece1a59ec077c5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf 2023-09-22 10:00:54,329 DEBUG [StoreOpener-917ac3c03433650ffc452e561717d738-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf 2023-09-22 10:00:54,329 DEBUG [StoreOpener-6766d3c5e0c1d8930ece1a59ec077c5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf 2023-09-22 10:00:54,330 INFO [StoreOpener-917ac3c03433650ffc452e561717d738-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 917ac3c03433650ffc452e561717d738 columnFamilyName cf 2023-09-22 10:00:54,330 INFO [StoreOpener-6766d3c5e0c1d8930ece1a59ec077c5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6766d3c5e0c1d8930ece1a59ec077c5f columnFamilyName cf 2023-09-22 10:00:54,331 INFO [StoreOpener-917ac3c03433650ffc452e561717d738-1] regionserver.HStore(310): Store=917ac3c03433650ffc452e561717d738/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:54,331 INFO [StoreOpener-6766d3c5e0c1d8930ece1a59ec077c5f-1] regionserver.HStore(310): Store=6766d3c5e0c1d8930ece1a59ec077c5f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:00:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:00:54,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 917ac3c03433650ffc452e561717d738 2023-09-22 10:00:54,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:54,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:00:54,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 917ac3c03433650ffc452e561717d738; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63578583, jitterRate=-0.0526052862405777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:54,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 6766d3c5e0c1d8930ece1a59ec077c5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74195308, jitterRate=0.10559624433517456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:00:54,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 917ac3c03433650ffc452e561717d738: 2023-09-22 10:00:54,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 6766d3c5e0c1d8930ece1a59ec077c5f: 2023-09-22 10:00:54,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738., pid=31, masterSystemTime=1695376854319 2023-09-22 10:00:54,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f., pid=30, masterSystemTime=1695376854317 2023-09-22 10:00:54,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,345 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=917ac3c03433650ffc452e561717d738, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:54,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:54,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376854345"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376854345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376854345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376854345"}]},"ts":"1695376854345"} 2023-09-22 10:00:54,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6766d3c5e0c1d8930ece1a59ec077c5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376854346"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376854346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376854346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376854346"}]},"ts":"1695376854346"} 2023-09-22 10:00:54,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-22 10:00:54,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 917ac3c03433650ffc452e561717d738, server=jenkins-hbase17.apache.org,44903,1695376830088 in 185 msec 2023-09-22 10:00:54,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-22 10:00:54,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, ASSIGN in 354 msec 2023-09-22 10:00:54,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6766d3c5e0c1d8930ece1a59ec077c5f, server=jenkins-hbase17.apache.org,32793,1695376830043 in 188 msec 2023-09-22 10:00:54,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-22 10:00:54,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, ASSIGN in 361 msec 2023-09-22 10:00:54,369 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:00:54,370 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376854370"}]},"ts":"1695376854370"} 2023-09-22 10:00:54,371 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-22 10:00:54,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:00:54,374 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-22 10:00:54,376 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 10:00:54,377 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:54,377 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:54,377 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:54,377 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:00:54,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:54,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:54,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:54,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:00:54,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 449 msec 2023-09-22 10:00:54,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 10:00:54,541 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-22 10:00:54,545 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-22 10:00:54,545 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,546 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:00:54,560 DEBUG [hconnection-0xf77cc8e-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:54,564 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:54,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:00:54,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376854570 (current time:1695376854570). 2023-09-22 10:00:54,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:00:54,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x0da43760 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:54,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@158f530, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:54,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:54,584 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:54,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0da43760 to 127.0.0.1:49896 2023-09-22 10:00:54,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:54,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x3c677c01 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:54,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10d453da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:54,600 DEBUG [hconnection-0x56e3c585-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:54,602 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:54,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c677c01 to 127.0.0.1:49896 2023-09-22 10:00:54,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:54,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 10:00:54,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:00:54,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:00:54,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:00:54,615 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:00:54,616 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695377454616 2023-09-22 10:00:54,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-22 10:00:54,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:00:54,619 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:00:54,619 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:00:54,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 10:00:54,621 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:00:54,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-22 10:00:54,625 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 10:00:54,627 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695377454627 2023-09-22 10:00:54,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,638 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-22 10:00:54,638 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:54,639 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-22 10:00:54,639 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-22 10:00:54,640 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,640 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,641 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:54,641 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:54,641 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:54,641 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:54,641 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 10:00:54,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 10:00:54,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,643 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 10:00:54,643 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 10:00:54,643 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:54,643 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:54,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,646 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 10:00:54,646 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 10:00:54,644 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 10:00:54,646 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 10:00:54,646 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 10:00:54,646 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 10:00:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 10:00:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 10:00:54,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,647 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 10:00:54,647 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:54,649 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 10:00:54,649 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 10:00:54,649 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 10:00:54,649 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,649 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:54,650 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,650 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:54,650 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,650 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,650 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:54,651 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,651 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,651 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:54,651 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23fcc803[Count = 1] remaining members to acquire global barrier 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:54,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-22 10:00:54,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23fcc803[Count = 0] remaining members to acquire global barrier 2023-09-22 10:00:54,655 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 10:00:54,655 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,656 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:00:54,657 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:00:54,657 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 10:00:54,657 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:00:54,657 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:54,657 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:54,657 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,657 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:00:54,657 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:54,657 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. started... 2023-09-22 10:00:54,657 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,659 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:00:54,659 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6766d3c5e0c1d8930ece1a59ec077c5f: 2023-09-22 10:00:54,659 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,659 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:54,659 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:00:54,659 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 10:00:54,659 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:54,660 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 10:00:54,664 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:54,666 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:54,666 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,666 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. started... 2023-09-22 10:00:54,666 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 917ac3c03433650ffc452e561717d738: 2023-09-22 10:00:54,667 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,667 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:54,667 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:00:54,686 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. completed. 2023-09-22 10:00:54,686 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 10:00:54,686 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:00:54,689 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:54,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:54,689 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 10:00:54,689 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:54,689 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 10:00:54,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,692 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. completed. 2023-09-22 10:00:54,692 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,692 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:54,693 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:54,693 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,693 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 10:00:54,693 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:00:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,694 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,694 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 10:00:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,694 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:54,694 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 10:00:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:00:54,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 10:00:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:54,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:54,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:54,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:00:54,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 10:00:54,701 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-22 10:00:54,701 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:00:54,701 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:00:54,701 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,701 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:54,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:54,703 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:54,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:54,704 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:54,705 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:54,706 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,706 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,707 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:54,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:54,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:54,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:54,709 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:54,709 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:54,711 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:54,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:54,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-22 10:00:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:54,711 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:54,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:00:54,712 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:54,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:54,712 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,712 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:54,712 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:54,712 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,712 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 10:00:54,719 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:54,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:00:54,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:00:54,721 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:00:54,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,753 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-22 10:00:54,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,753 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 10:00:54,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695376854616Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695376854724 (+108 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695376854724Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695376854724Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695376854728 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695376854742 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695376854753 (+11 ms) 2023-09-22 10:00:54,757 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 10:00:54,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 139 msec 2023-09-22 10:00:54,921 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:54,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:00:54,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:00:54,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:00:54,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32793] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:00:54,937 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-22 10:00:54,937 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:54,937 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:00:54,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:00:54,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376854953 (current time:1695376854953). 2023-09-22 10:00:54,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:00:54,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x4dacc26b to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:54,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@630241be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:54,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:54,968 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:54,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dacc26b to 127.0.0.1:49896 2023-09-22 10:00:54,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:54,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x1773868a to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:00:54,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d990816, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:00:54,979 DEBUG [hconnection-0x3fe61d78-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:00:54,983 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:00:54,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1773868a to 127.0.0.1:49896 2023-09-22 10:00:54,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:00:54,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 10:00:54,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:00:54,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:00:54,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:00:54,998 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:00:54,999 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695377454999 2023-09-22 10:00:54,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-22 10:00:54,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:00:55,001 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:00:55,002 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:00:55,005 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:00:55,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 10:00:55,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-22 10:00:55,009 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 10:00:55,010 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695377455010 2023-09-22 10:00:55,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-22 10:00:55,023 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-22 10:00:55,023 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:55,024 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-22 10:00:55,024 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-22 10:00:55,025 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,025 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,026 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:55,026 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:55,026 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,026 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:55,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:55,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:55,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:55,026 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:55,026 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,027 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 10:00:55,027 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 10:00:55,027 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 10:00:55,028 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:55,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 10:00:55,029 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 10:00:55,029 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 10:00:55,027 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:55,029 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 10:00:55,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 10:00:55,030 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 10:00:55,030 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 10:00:55,030 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 10:00:55,030 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 10:00:55,031 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:00:55,032 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 10:00:55,032 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 10:00:55,032 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 10:00:55,033 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,033 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,033 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:55,034 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:55,034 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:00:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15e33026[Count = 1] remaining members to acquire global barrier 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:55,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-22 10:00:55,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15e33026[Count = 0] remaining members to acquire global barrier 2023-09-22 10:00:55,038 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 10:00:55,038 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:00:55,039 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:00:55,039 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 10:00:55,039 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. started... 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:00:55,039 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,039 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:00:55,039 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. started... 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:55,039 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 917ac3c03433650ffc452e561717d738 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-22 10:00:55,039 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:00:55,039 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:00:55,039 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6766d3c5e0c1d8930ece1a59ec077c5f 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-22 10:00:55,040 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 10:00:55,040 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:55,040 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 10:00:55,084 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309221d42190776f2465d9d186ef6f3bcf83c to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309221d42190776f2465d9d186ef6f3bcf83c 2023-09-22 10:00:55,084 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922c269c7275acd44a78d5c5604367754e8 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922c269c7275acd44a78d5c5604367754e8 2023-09-22 10:00:55,098 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/.tmp/cf/ca69adfdcbc24afeb9f691c86619fe66 2023-09-22 10:00:55,098 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/.tmp/cf/7b20bd60a5194628834eba81155a7b87 2023-09-22 10:00:55,102 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:55,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:00:55,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:00:55,103 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:00:55,107 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/.tmp/cf/ca69adfdcbc24afeb9f691c86619fe66 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf/ca69adfdcbc24afeb9f691c86619fe66 2023-09-22 10:00:55,107 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/.tmp/cf/7b20bd60a5194628834eba81155a7b87 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf/7b20bd60a5194628834eba81155a7b87 2023-09-22 10:00:55,113 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf/ca69adfdcbc24afeb9f691c86619fe66, entries=44, sequenceid=6, filesize=12.3 K 2023-09-22 10:00:55,113 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf/7b20bd60a5194628834eba81155a7b87, entries=6, sequenceid=6, filesize=5.9 K 2023-09-22 10:00:55,114 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 917ac3c03433650ffc452e561717d738 in 75ms, sequenceid=6, compaction requested=false 2023-09-22 10:00:55,114 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 6766d3c5e0c1d8930ece1a59ec077c5f in 75ms, sequenceid=6, compaction requested=false 2023-09-22 10:00:55,115 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-22 10:00:55,115 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-22 10:00:55,118 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 917ac3c03433650ffc452e561717d738: 2023-09-22 10:00:55,118 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6766d3c5e0c1d8930ece1a59ec077c5f: 2023-09-22 10:00:55,118 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 10:00:55,118 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 10:00:55,118 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:55,119 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:00:55,119 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf/7b20bd60a5194628834eba81155a7b87] hfiles 2023-09-22 10:00:55,119 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf/ca69adfdcbc24afeb9f691c86619fe66] hfiles 2023-09-22 10:00:55,119 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf/7b20bd60a5194628834eba81155a7b87 for snapshot=snaptb0-testExportFileSystemState 2023-09-22 10:00:55,119 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf/ca69adfdcbc24afeb9f691c86619fe66 for snapshot=snaptb0-testExportFileSystemState 2023-09-22 10:00:55,137 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. completed. 2023-09-22 10:00:55,137 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:00:55,137 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:55,137 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:55,137 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,137 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 10:00:55,138 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:00:55,140 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,140 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 10:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:55,140 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:55,140 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 10:00:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:55,142 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. completed. 2023-09-22 10:00:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:55,143 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:00:55,143 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:00:55,143 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:00:55,143 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,143 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 10:00:55,143 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:00:55,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,144 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,144 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 10:00:55,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,144 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:55,144 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 10:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:55,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:00:55,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 10:00:55,151 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-22 10:00:55,151 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:00:55,151 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:00:55,151 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-22 10:00:55,151 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:55,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:55,152 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:00:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,152 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:55,153 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:00:55,153 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:00:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,155 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,155 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,156 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:00:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 10:00:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,158 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,158 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:55,158 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:55,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:55,158 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,159 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:55,158 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:55,159 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:55,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:55,159 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:55,159 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:00:55,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-22 10:00:55,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-22 10:00:55,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:00:55,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:00:55,159 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:00:55,159 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:00:55,159 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 10:00:55,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:55,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:55,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:00:55,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:00:55,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:55,161 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:00:55,162 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,162 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:00:55,162 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:00:55,162 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,162 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:55,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:00:55,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922c269c7275acd44a78d5c5604367754e8, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309221d42190776f2465d9d186ef6f3bcf83c] mob files 2023-09-22 10:00:55,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922c269c7275acd44a78d5c5604367754e8 2023-09-22 10:00:55,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309221d42190776f2465d9d186ef6f3bcf83c 2023-09-22 10:00:55,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-22 10:00:55,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-22 10:00:55,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,208 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695376855000Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695376855171 (+171 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695376855171Loading Region manifests for snaptb0-testExportFileSystemState at 1695376855171Writing data manifest for snaptb0-testExportFileSystemState at 1695376855180 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695376855197 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695376855207 (+10 ms) 2023-09-22 10:00:55,211 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 10:00:55,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 210 msec 2023-09-22 10:00:55,303 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:00:55,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:00:55,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:00:55,305 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305 2023-09-22 10:00:55,305 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39103, tgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305, rawTgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:55,332 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:00:55,333 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1994456129_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,333 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-22 10:00:55,349 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 10:00:55,378 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:55,379 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:55,379 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:55,380 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,157 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-95599280297670272.jar 2023-09-22 10:00:56,157 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,158 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,214 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-6076160209692328985.jar 2023-09-22 10:00:56,215 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,215 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,215 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,216 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,216 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,216 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:00:56,217 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:00:56,217 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:00:56,217 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:00:56,218 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:00:56,218 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:00:56,218 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:00:56,219 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:00:56,219 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:00:56,219 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:00:56,219 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:00:56,220 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:56,220 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:56,221 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:00:56,221 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:56,221 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:00:56,222 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:00:56,222 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:00:56,636 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:00:56,640 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-22 10:00:56,643 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-22 10:00:57,624 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:00:57,625 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:00:57,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0001_000001 (auth:SIMPLE) 2023-09-22 10:00:58,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0002_000001 (auth:SIMPLE) 2023-09-22 10:00:59,199 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:01:02,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0002_000001 (auth:SIMPLE) 2023-09-22 10:01:04,253 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0002_000001 (auth:SIMPLE) 2023-09-22 10:01:06,421 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0002_000001 (auth:SIMPLE) 2023-09-22 10:01:07,853 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:01:07,854 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:01:07,861 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-22 10:01:07,862 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:01:07,862 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:01:07,862 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 10:01:07,863 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-22 10:01:07,863 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-22 10:01:07,863 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 10:01:07,863 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-22 10:01:07,863 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376855305/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-22 10:01:07,871 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-22 10:01:07,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-09-22 10:01:07,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:07,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 10:01:07,877 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376867876"}]},"ts":"1695376867876"} 2023-09-22 10:01:07,878 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-22 10:01:07,880 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-22 10:01:07,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, UNASSIGN}] 2023-09-22 10:01:07,883 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, UNASSIGN 2023-09-22 10:01:07,883 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, UNASSIGN 2023-09-22 10:01:07,884 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6766d3c5e0c1d8930ece1a59ec077c5f, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:07,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=917ac3c03433650ffc452e561717d738, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:07,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376867884"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376867884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376867884"}]},"ts":"1695376867884"} 2023-09-22 10:01:07,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376867884"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376867884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376867884"}]},"ts":"1695376867884"} 2023-09-22 10:01:07,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 6766d3c5e0c1d8930ece1a59ec077c5f, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:07,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 917ac3c03433650ffc452e561717d738, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:01:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 10:01:08,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 917ac3c03433650ffc452e561717d738 2023-09-22 10:01:08,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 917ac3c03433650ffc452e561717d738, disabling compactions & flushes 2023-09-22 10:01:08,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:01:08,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:01:08,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:01:08,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 6766d3c5e0c1d8930ece1a59ec077c5f, disabling compactions & flushes 2023-09-22 10:01:08,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:01:08,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:01:08,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. after waiting 0 ms 2023-09-22 10:01:08,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:01:08,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. after waiting 0 ms 2023-09-22 10:01:08,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:01:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:01:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:01:08,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:08,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:08,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f. 2023-09-22 10:01:08,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738. 2023-09-22 10:01:08,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 917ac3c03433650ffc452e561717d738: 2023-09-22 10:01:08,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 6766d3c5e0c1d8930ece1a59ec077c5f: 2023-09-22 10:01:08,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 917ac3c03433650ffc452e561717d738 2023-09-22 10:01:08,064 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=917ac3c03433650ffc452e561717d738, regionState=CLOSED 2023-09-22 10:01:08,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:01:08,064 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376868064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376868064"}]},"ts":"1695376868064"} 2023-09-22 10:01:08,065 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6766d3c5e0c1d8930ece1a59ec077c5f, regionState=CLOSED 2023-09-22 10:01:08,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695376868065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376868065"}]},"ts":"1695376868065"} 2023-09-22 10:01:08,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-22 10:01:08,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 917ac3c03433650ffc452e561717d738, server=jenkins-hbase17.apache.org,44903,1695376830088 in 178 msec 2023-09-22 10:01:08,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-22 10:01:08,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 6766d3c5e0c1d8930ece1a59ec077c5f, server=jenkins-hbase17.apache.org,32793,1695376830043 in 181 msec 2023-09-22 10:01:08,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=917ac3c03433650ffc452e561717d738, UNASSIGN in 187 msec 2023-09-22 10:01:08,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-22 10:01:08,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6766d3c5e0c1d8930ece1a59ec077c5f, UNASSIGN in 188 msec 2023-09-22 10:01:08,072 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376868072"}]},"ts":"1695376868072"} 2023-09-22 10:01:08,074 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-22 10:01:08,075 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-22 10:01:08,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 205 msec 2023-09-22 10:01:08,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 10:01:08,181 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-22 10:01:08,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-09-22 10:01:08,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:08,191 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:08,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-22 10:01:08,192 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:08,193 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-22 10:01:08,195 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,195 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,195 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,195 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 10:01:08,196 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 10:01:08,196 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 10:01:08,196 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 10:01:08,196 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-22 10:01:08,198 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 2023-09-22 10:01:08,198 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:01:08,200 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/recovered.edits] 2023-09-22 10:01:08,200 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/recovered.edits] 2023-09-22 10:01:08,204 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf/7b20bd60a5194628834eba81155a7b87 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/cf/7b20bd60a5194628834eba81155a7b87 2023-09-22 10:01:08,204 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf/ca69adfdcbc24afeb9f691c86619fe66 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/cf/ca69adfdcbc24afeb9f691c86619fe66 2023-09-22 10:01:08,207 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f/recovered.edits/9.seqid 2023-09-22 10:01:08,207 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738/recovered.edits/9.seqid 2023-09-22 10:01:08,207 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/6766d3c5e0c1d8930ece1a59ec077c5f 2023-09-22 10:01:08,207 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemState/917ac3c03433650ffc452e561717d738 2023-09-22 10:01:08,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-22 10:01:08,208 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-22 10:01:08,209 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-22 10:01:08,212 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922c269c7275acd44a78d5c5604367754e8 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922c269c7275acd44a78d5c5604367754e8 2023-09-22 10:01:08,213 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309221d42190776f2465d9d186ef6f3bcf83c to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309221d42190776f2465d9d186ef6f3bcf83c 2023-09-22 10:01:08,214 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-22 10:01:08,216 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:08,218 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-22 10:01:08,221 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-22 10:01:08,222 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:08,223 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-22 10:01:08,223 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376868223"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:08,223 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376868223"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:08,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 10:01:08,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 917ac3c03433650ffc452e561717d738, NAME => 'testtb-testExportFileSystemState,,1695376853927.917ac3c03433650ffc452e561717d738.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6766d3c5e0c1d8930ece1a59ec077c5f, NAME => 'testtb-testExportFileSystemState,1,1695376853927.6766d3c5e0c1d8930ece1a59ec077c5f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 10:01:08,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-22 10:01:08,226 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376868226"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:08,228 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-22 10:01:08,230 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 10:01:08,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-09-22 10:01:08,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-22 10:01:08,299 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-22 10:01:08,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-22 10:01:08,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-22 10:01:08,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-09-22 10:01:08,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-22 10:01:08,340 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=770 (was 757) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:37399 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1711351085_1 at /127.0.0.1:38026 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:38044 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:46826 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:33643 from appattempt_1695376836352_0002_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1711351085_1 at /127.0.0.1:46810 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2077 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=928 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 237) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6847 (was 6946) 2023-09-22 10:01:08,340 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-09-22 10:01:08,364 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=169, AvailableMemoryMB=6844 2023-09-22 10:01:08,364 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-09-22 10:01:08,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 10:01:08,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:08,372 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:01:08,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-22 10:01:08,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:01:08,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 10:01:08,376 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,376 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,377 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f empty. 2023-09-22 10:01:08,377 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 empty. 2023-09-22 10:01:08,377 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,377 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,378 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-22 10:01:08,393 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-22 10:01:08,397 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 841be4a73c8140df1a19fe8a08e4957f, NAME => 'testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:08,397 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a733fbb772f3aae19240f7bf4a1d1b93, NAME => 'testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:08,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:08,421 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a733fbb772f3aae19240f7bf4a1d1b93, disabling compactions & flushes 2023-09-22 10:01:08,421 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,421 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,421 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. after waiting 0 ms 2023-09-22 10:01:08,421 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,421 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,421 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a733fbb772f3aae19240f7bf4a1d1b93: 2023-09-22 10:01:08,422 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:08,423 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 841be4a73c8140df1a19fe8a08e4957f, disabling compactions & flushes 2023-09-22 10:01:08,423 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,423 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,423 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. after waiting 0 ms 2023-09-22 10:01:08,423 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,423 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,423 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 841be4a73c8140df1a19fe8a08e4957f: 2023-09-22 10:01:08,426 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:01:08,427 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376868427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376868427"}]},"ts":"1695376868427"} 2023-09-22 10:01:08,427 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376868427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376868427"}]},"ts":"1695376868427"} 2023-09-22 10:01:08,430 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:01:08,431 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:01:08,431 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376868431"}]},"ts":"1695376868431"} 2023-09-22 10:01:08,433 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-22 10:01:08,435 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:01:08,437 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:01:08,437 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:01:08,437 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:01:08,437 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:01:08,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, ASSIGN}] 2023-09-22 10:01:08,443 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, ASSIGN 2023-09-22 10:01:08,443 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, ASSIGN 2023-09-22 10:01:08,444 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:01:08,444 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44903,1695376830088; forceNewPlan=false, retain=false 2023-09-22 10:01:08,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 10:01:08,595 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:01:08,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a733fbb772f3aae19240f7bf4a1d1b93, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:08,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=841be4a73c8140df1a19fe8a08e4957f, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:08,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376868601"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376868601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376868601"}]},"ts":"1695376868601"} 2023-09-22 10:01:08,602 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376868601"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376868601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376868601"}]},"ts":"1695376868601"} 2023-09-22 10:01:08,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure a733fbb772f3aae19240f7bf4a1d1b93, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:01:08,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 841be4a73c8140df1a19fe8a08e4957f, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:08,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 10:01:08,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a733fbb772f3aae19240f7bf4a1d1b93, NAME => 'testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 10:01:08,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. service=AccessControlService 2023-09-22 10:01:08,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:08,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 841be4a73c8140df1a19fe8a08e4957f, NAME => 'testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 10:01:08,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. service=AccessControlService 2023-09-22 10:01:08,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:08,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,770 INFO [StoreOpener-a733fbb772f3aae19240f7bf4a1d1b93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,770 INFO [StoreOpener-841be4a73c8140df1a19fe8a08e4957f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,771 DEBUG [StoreOpener-a733fbb772f3aae19240f7bf4a1d1b93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf 2023-09-22 10:01:08,772 DEBUG [StoreOpener-a733fbb772f3aae19240f7bf4a1d1b93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf 2023-09-22 10:01:08,772 DEBUG [StoreOpener-841be4a73c8140df1a19fe8a08e4957f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf 2023-09-22 10:01:08,772 DEBUG [StoreOpener-841be4a73c8140df1a19fe8a08e4957f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf 2023-09-22 10:01:08,772 INFO [StoreOpener-a733fbb772f3aae19240f7bf4a1d1b93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a733fbb772f3aae19240f7bf4a1d1b93 columnFamilyName cf 2023-09-22 10:01:08,772 INFO [StoreOpener-841be4a73c8140df1a19fe8a08e4957f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 841be4a73c8140df1a19fe8a08e4957f columnFamilyName cf 2023-09-22 10:01:08,774 INFO [StoreOpener-a733fbb772f3aae19240f7bf4a1d1b93-1] regionserver.HStore(310): Store=a733fbb772f3aae19240f7bf4a1d1b93/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:08,774 INFO [StoreOpener-841be4a73c8140df1a19fe8a08e4957f-1] regionserver.HStore(310): Store=841be4a73c8140df1a19fe8a08e4957f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:08,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:08,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:08,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:08,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:08,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a733fbb772f3aae19240f7bf4a1d1b93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61739384, jitterRate=-0.08001148700714111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:08,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a733fbb772f3aae19240f7bf4a1d1b93: 2023-09-22 10:01:08,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 841be4a73c8140df1a19fe8a08e4957f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67923362, jitterRate=0.012136965990066528}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:08,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 841be4a73c8140df1a19fe8a08e4957f: 2023-09-22 10:01:08,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93., pid=45, masterSystemTime=1695376868759 2023-09-22 10:01:08,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f., pid=46, masterSystemTime=1695376868760 2023-09-22 10:01:08,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:08,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a733fbb772f3aae19240f7bf4a1d1b93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:08,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376868786"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376868786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376868786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376868786"}]},"ts":"1695376868786"} 2023-09-22 10:01:08,787 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=841be4a73c8140df1a19fe8a08e4957f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:08,787 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376868787"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376868787"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376868787"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376868787"}]},"ts":"1695376868787"} 2023-09-22 10:01:08,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-22 10:01:08,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure a733fbb772f3aae19240f7bf4a1d1b93, server=jenkins-hbase17.apache.org,44903,1695376830088 in 182 msec 2023-09-22 10:01:08,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-22 10:01:08,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 841be4a73c8140df1a19fe8a08e4957f, server=jenkins-hbase17.apache.org,32793,1695376830043 in 181 msec 2023-09-22 10:01:08,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, ASSIGN in 354 msec 2023-09-22 10:01:08,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-22 10:01:08,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, ASSIGN in 355 msec 2023-09-22 10:01:08,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:01:08,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376868794"}]},"ts":"1695376868794"} 2023-09-22 10:01:08,795 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-22 10:01:08,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:01:08,797 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-22 10:01:08,799 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 10:01:08,800 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,800 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,800 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,800 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:08,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:08,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:08,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:08,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:08,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 434 msec 2023-09-22 10:01:08,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 10:01:08,979 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-22 10:01:08,981 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-22 10:01:08,981 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:08,984 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:01:09,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 10:01:09,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376869000 (current time:1695376869000). 2023-09-22 10:01:09,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:09,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x74e67880 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:09,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12094384, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:09,012 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:09,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74e67880 to 127.0.0.1:49896 2023-09-22 10:01:09,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:09,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x75ac1798 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:09,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@324943d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:09,026 DEBUG [hconnection-0x6a84237b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:09,030 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:09,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75ac1798 to 127.0.0.1:49896 2023-09-22 10:01:09,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:09,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 10:01:09,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:09,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 10:01:09,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 10:01:09,041 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 10:01:09,042 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695377469042 2023-09-22 10:01:09,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 10:01:09,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-22 10:01:09,044 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:09,044 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:09,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 10:01:09,046 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 10:01:09,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-22 10:01:09,048 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 10:01:09,049 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695377469049 2023-09-22 10:01:09,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,062 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-22 10:01:09,062 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,063 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-22 10:01:09,063 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-22 10:01:09,063 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,063 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,064 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,064 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,064 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,065 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,065 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,065 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 10:01:09,066 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 10:01:09,066 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,066 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 10:01:09,066 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 10:01:09,066 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,066 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 10:01:09,067 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,067 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 10:01:09,069 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 10:01:09,069 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 10:01:09,066 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,069 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 10:01:09,069 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 10:01:09,072 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 10:01:09,072 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 10:01:09,072 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 10:01:09,072 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 10:01:09,073 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,073 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,073 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,074 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,074 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eefeadd[Count = 1] remaining members to acquire global barrier 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-22 10:01:09,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eefeadd[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:09,079 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-22 10:01:09,079 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 10:01:09,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,081 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 10:01:09,081 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,081 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:09,081 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:09,081 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:09,081 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. started... 2023-09-22 10:01:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,082 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,082 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:09,082 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:09,082 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 841be4a73c8140df1a19fe8a08e4957f: 2023-09-22 10:01:09,082 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:09,082 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. started... 2023-09-22 10:01:09,082 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:01:09,084 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a733fbb772f3aae19240f7bf4a1d1b93: 2023-09-22 10:01:09,084 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 10:01:09,084 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,084 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,084 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:09,084 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 10:01:09,086 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:01:09,102 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. completed. 2023-09-22 10:01:09,102 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:09,102 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. completed. 2023-09-22 10:01:09,102 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:09,102 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:09,102 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,102 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:09,102 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 10:01:09,102 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:09,102 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:09,103 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:09,103 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,103 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 10:01:09,103 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:09,103 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 10:01:09,104 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,104 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,104 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 10:01:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,105 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,105 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 10:01:09,105 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,105 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 10:01:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-22 10:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:01:09,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-22 10:01:09,113 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-22 10:01:09,113 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:09,113 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:09,113 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,113 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:09,115 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,115 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,116 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,115 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,116 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,117 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,117 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,121 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,121 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,122 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,124 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,125 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,125 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-22 10:01:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,127 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,127 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:01:09,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 10:01:09,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,144 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:09,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 10:01:09,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:01:09,145 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:01:09,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-22 10:01:09,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,160 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:09,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695376869042Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695376869135 (+93 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695376869135Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695376869135Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695376869139 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695376869153 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695376869159 (+6 ms) 2023-09-22 10:01:09,162 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 10:01:09,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 118 msec 2023-09-22 10:01:09,346 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:09,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 10:01:09,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:09,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32793] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:01:09,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:01:09,362 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-22 10:01:09,362 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:09,363 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:01:09,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 10:01:09,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376869376 (current time:1695376869376). 2023-09-22 10:01:09,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:09,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x5f60bd56 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:09,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54fc2286, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:09,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:09,393 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:09,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f60bd56 to 127.0.0.1:49896 2023-09-22 10:01:09,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x3cc077cb to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:09,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6690e708, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:09,409 DEBUG [hconnection-0x53cd114e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:09,410 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:09,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cc077cb to 127.0.0.1:49896 2023-09-22 10:01:09,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:09,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 10:01:09,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:09,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 10:01:09,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 10:01:09,421 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 10:01:09,422 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695377469422 2023-09-22 10:01:09,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 10:01:09,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-22 10:01:09,424 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:09,424 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:09,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 10:01:09,426 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 10:01:09,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-22 10:01:09,428 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 10:01:09,429 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695377469429 2023-09-22 10:01:09,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-22 10:01:09,441 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-22 10:01:09,442 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,443 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-22 10:01:09,443 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-22 10:01:09,443 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,443 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,444 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,444 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,444 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,444 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,445 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,445 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,445 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,446 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 10:01:09,446 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 10:01:09,446 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 10:01:09,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 10:01:09,446 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,446 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 10:01:09,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 10:01:09,448 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:09,449 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 10:01:09,449 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 10:01:09,449 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 10:01:09,450 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,450 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,450 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:09,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,451 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:09,451 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2566c442[Count = 1] remaining members to acquire global barrier 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-22 10:01:09,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2566c442[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:09,455 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-22 10:01:09,455 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,455 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,455 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,455 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 10:01:09,456 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,456 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 10:01:09,456 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 10:01:09,456 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 10:01:09,456 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:09,456 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,456 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:09,457 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 10:01:09,457 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,457 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 10:01:09,459 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:09,461 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:09,461 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:09,461 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:09,461 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:09,461 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. started... 2023-09-22 10:01:09,461 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:09,461 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. started... 2023-09-22 10:01:09,461 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 841be4a73c8140df1a19fe8a08e4957f 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-22 10:01:09,462 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a733fbb772f3aae19240f7bf4a1d1b93 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-22 10:01:09,490 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309227fa52d44a8b047e690b2e03aa8af0d59 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309227fa52d44a8b047e690b2e03aa8af0d59 2023-09-22 10:01:09,491 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922888bb9c3f9234dabbba0a7b1e7702c8b to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922888bb9c3f9234dabbba0a7b1e7702c8b 2023-09-22 10:01:09,508 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/.tmp/cf/8cfdc355e48d430b96d2ca2abd2ca00c 2023-09-22 10:01:09,508 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/.tmp/cf/b4a61d7d5eda454691b29e7d645a999d 2023-09-22 10:01:09,514 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/.tmp/cf/8cfdc355e48d430b96d2ca2abd2ca00c as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf/8cfdc355e48d430b96d2ca2abd2ca00c 2023-09-22 10:01:09,514 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/.tmp/cf/b4a61d7d5eda454691b29e7d645a999d as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf/b4a61d7d5eda454691b29e7d645a999d 2023-09-22 10:01:09,519 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf/b4a61d7d5eda454691b29e7d645a999d, entries=1, sequenceid=6, filesize=5.1 K 2023-09-22 10:01:09,519 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf/8cfdc355e48d430b96d2ca2abd2ca00c, entries=49, sequenceid=6, filesize=13.0 K 2023-09-22 10:01:09,520 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 841be4a73c8140df1a19fe8a08e4957f in 59ms, sequenceid=6, compaction requested=false 2023-09-22 10:01:09,520 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for a733fbb772f3aae19240f7bf4a1d1b93 in 59ms, sequenceid=6, compaction requested=false 2023-09-22 10:01:09,520 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-22 10:01:09,520 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-22 10:01:09,522 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 841be4a73c8140df1a19fe8a08e4957f: 2023-09-22 10:01:09,522 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a733fbb772f3aae19240f7bf4a1d1b93: 2023-09-22 10:01:09,522 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf/b4a61d7d5eda454691b29e7d645a999d] hfiles 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf/8cfdc355e48d430b96d2ca2abd2ca00c] hfiles 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf/b4a61d7d5eda454691b29e7d645a999d for snapshot=snaptb0-testConsecutiveExports 2023-09-22 10:01:09,523 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf/8cfdc355e48d430b96d2ca2abd2ca00c for snapshot=snaptb0-testConsecutiveExports 2023-09-22 10:01:09,524 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:09,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 10:01:09,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:01:09,526 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:01:09,545 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. completed. 2023-09-22 10:01:09,545 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:09,545 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:09,545 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:09,545 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:09,546 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. completed. 2023-09-22 10:01:09,546 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 10:01:09,546 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:09,547 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 10:01:09,547 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,547 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,547 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 10:01:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,549 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,549 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 10:01:09,549 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,549 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 10:01:09,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:09,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-22 10:01:09,556 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-22 10:01:09,556 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:09,556 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:09,556 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-22 10:01:09,556 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,557 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:09,557 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:09,558 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,559 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:09,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:09,560 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 10:01:09,560 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,561 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:09,564 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-22 10:01:09,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-22 10:01:09,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:09,564 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 10:01:09,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:01:09,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,566 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,567 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:09,567 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,567 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:09,567 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:09,567 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,567 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:09,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:09,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922888bb9c3f9234dabbba0a7b1e7702c8b, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309227fa52d44a8b047e690b2e03aa8af0d59] mob files 2023-09-22 10:01:09,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922888bb9c3f9234dabbba0a7b1e7702c8b 2023-09-22 10:01:09,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309227fa52d44a8b047e690b2e03aa8af0d59 2023-09-22 10:01:09,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-22 10:01:09,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-22 10:01:09,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,601 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695376869422Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695376869579 (+157 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695376869579Loading Region manifests for snaptb0-testConsecutiveExports at 1695376869579Writing data manifest for snaptb0-testConsecutiveExports at 1695376869583 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695376869593 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695376869601 (+8 ms) 2023-09-22 10:01:09,604 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 10:01:09,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 180 msec 2023-09-22 10:01:09,726 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:09,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 10:01:09,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:09,729 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728 2023-09-22 10:01:09,729 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:09,754 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:09,754 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3208044e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,754 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-22 10:01:09,762 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:09,773 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:09,774 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:09,774 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:09,774 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,487 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-7449546620402430878.jar 2023-09-22 10:01:10,488 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,488 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,541 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-8651788186971267206.jar 2023-09-22 10:01:10,542 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,542 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,542 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,543 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,543 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,543 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:10,544 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:01:10,544 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:01:10,544 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:01:10,545 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:01:10,545 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:01:10,545 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:01:10,546 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:01:10,546 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:01:10,546 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:01:10,547 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:01:10,547 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:10,548 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:10,548 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:10,548 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:10,548 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:10,549 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:10,549 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:10,896 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:01:10,898 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-22 10:01:10,900 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-22 10:01:12,618 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:12,618 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:12,620 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0002_000001 (auth:SIMPLE) 2023-09-22 10:01:12,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0003_000001 (auth:SIMPLE) 2023-09-22 10:01:13,642 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:01:16,140 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0003_000001 (auth:SIMPLE) 2023-09-22 10:01:18,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0003_000001 (auth:SIMPLE) 2023-09-22 10:01:20,931 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0003_000001 (auth:SIMPLE) 2023-09-22 10:01:20,941 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695376836352_0003_01_000002 is : 143 2023-09-22 10:01:22,096 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:01:22,097 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:01:22,100 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-22 10:01:22,101 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:01:22,101 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:01:22,101 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 10:01:22,104 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 10:01:22,104 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 10:01:22,104 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@145cdebb in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 10:01:22,104 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 10:01:22,104 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 10:01:22,106 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:22,125 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:22,125 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@16d41d8f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:22,125 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-22 10:01:22,137 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 10:01:22,152 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,153 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,153 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,153 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,858 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-1459045296713161217.jar 2023-09-22 10:01:22,859 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,859 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,913 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-2111510386274449037.jar 2023-09-22 10:01:22,913 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,914 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,914 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,914 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,915 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,915 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:22,915 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:01:22,916 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:01:22,916 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:01:22,916 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:01:22,917 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:01:22,917 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:01:22,917 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:01:22,918 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:01:22,918 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:01:22,918 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:01:22,919 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:22,919 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:22,920 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:22,920 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:22,920 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:22,920 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:22,921 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:23,288 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:01:23,291 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-22 10:01:23,294 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-22 10:01:27,121 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:27,121 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:27,123 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0003_000001 (auth:SIMPLE) 2023-09-22 10:01:27,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0004_000001 (auth:SIMPLE) 2023-09-22 10:01:31,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0004_000001 (auth:SIMPLE) 2023-09-22 10:01:33,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0004_000001 (auth:SIMPLE) 2023-09-22 10:01:35,529 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0004_000001 (auth:SIMPLE) 2023-09-22 10:01:37,498 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:01:37,499 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:01:37,501 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-22 10:01:37,501 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:01:37,502 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:01:37,502 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 10:01:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 10:01:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 10:01:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@145cdebb in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 10:01:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 10:01:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/local-export-1695376869728/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 10:01:37,516 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-22 10:01:37,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-09-22 10:01:37,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 10:01:37,520 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376897520"}]},"ts":"1695376897520"} 2023-09-22 10:01:37,521 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-22 10:01:37,522 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-22 10:01:37,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, UNASSIGN}] 2023-09-22 10:01:37,525 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, UNASSIGN 2023-09-22 10:01:37,525 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, UNASSIGN 2023-09-22 10:01:37,526 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a733fbb772f3aae19240f7bf4a1d1b93, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:37,526 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=841be4a73c8140df1a19fe8a08e4957f, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:37,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376897526"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376897526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376897526"}]},"ts":"1695376897526"} 2023-09-22 10:01:37,526 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376897526"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376897526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376897526"}]},"ts":"1695376897526"} 2023-09-22 10:01:37,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure a733fbb772f3aae19240f7bf4a1d1b93, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:01:37,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 841be4a73c8140df1a19fe8a08e4957f, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:37,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 10:01:37,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:37,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:37,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 841be4a73c8140df1a19fe8a08e4957f, disabling compactions & flushes 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a733fbb772f3aae19240f7bf4a1d1b93, disabling compactions & flushes 2023-09-22 10:01:37,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:37,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. after waiting 0 ms 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. after waiting 0 ms 2023-09-22 10:01:37,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:37,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:01:37,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:01:37,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:37,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:37,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93. 2023-09-22 10:01:37,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f. 2023-09-22 10:01:37,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 841be4a73c8140df1a19fe8a08e4957f: 2023-09-22 10:01:37,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a733fbb772f3aae19240f7bf4a1d1b93: 2023-09-22 10:01:37,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:37,698 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a733fbb772f3aae19240f7bf4a1d1b93, regionState=CLOSED 2023-09-22 10:01:37,698 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376897698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376897698"}]},"ts":"1695376897698"} 2023-09-22 10:01:37,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:37,698 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=841be4a73c8140df1a19fe8a08e4957f, regionState=CLOSED 2023-09-22 10:01:37,698 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695376897698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376897698"}]},"ts":"1695376897698"} 2023-09-22 10:01:37,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-22 10:01:37,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure a733fbb772f3aae19240f7bf4a1d1b93, server=jenkins-hbase17.apache.org,44903,1695376830088 in 172 msec 2023-09-22 10:01:37,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-22 10:01:37,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 841be4a73c8140df1a19fe8a08e4957f, server=jenkins-hbase17.apache.org,32793,1695376830043 in 172 msec 2023-09-22 10:01:37,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a733fbb772f3aae19240f7bf4a1d1b93, UNASSIGN in 178 msec 2023-09-22 10:01:37,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-22 10:01:37,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=841be4a73c8140df1a19fe8a08e4957f, UNASSIGN in 179 msec 2023-09-22 10:01:37,704 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376897704"}]},"ts":"1695376897704"} 2023-09-22 10:01:37,706 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-22 10:01:37,707 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-22 10:01:37,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 192 msec 2023-09-22 10:01:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 10:01:37,824 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-22 10:01:37,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-09-22 10:01:37,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-22 10:01:37,830 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,832 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-22 10:01:37,835 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,835 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,835 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,836 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 10:01:37,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 10:01:37,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 10:01:37,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:37,837 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:37,838 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:37,838 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:37,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-22 10:01:37,840 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/recovered.edits] 2023-09-22 10:01:37,840 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/recovered.edits] 2023-09-22 10:01:37,845 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf/b4a61d7d5eda454691b29e7d645a999d to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/cf/b4a61d7d5eda454691b29e7d645a999d 2023-09-22 10:01:37,845 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf/8cfdc355e48d430b96d2ca2abd2ca00c to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/cf/8cfdc355e48d430b96d2ca2abd2ca00c 2023-09-22 10:01:37,848 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f/recovered.edits/9.seqid 2023-09-22 10:01:37,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93/recovered.edits/9.seqid 2023-09-22 10:01:37,849 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/841be4a73c8140df1a19fe8a08e4957f 2023-09-22 10:01:37,850 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testConsecutiveExports/a733fbb772f3aae19240f7bf4a1d1b93 2023-09-22 10:01:37,850 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-22 10:01:37,850 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-22 10:01:37,851 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-22 10:01:37,854 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922888bb9c3f9234dabbba0a7b1e7702c8b to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922888bb9c3f9234dabbba0a7b1e7702c8b 2023-09-22 10:01:37,855 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309227fa52d44a8b047e690b2e03aa8af0d59 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309227fa52d44a8b047e690b2e03aa8af0d59 2023-09-22 10:01:37,856 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-22 10:01:37,858 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,860 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-22 10:01:37,863 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-22 10:01:37,864 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,864 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-22 10:01:37,865 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376897864"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:37,865 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376897864"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:37,867 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 10:01:37,867 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 841be4a73c8140df1a19fe8a08e4957f, NAME => 'testtb-testConsecutiveExports,,1695376868366.841be4a73c8140df1a19fe8a08e4957f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a733fbb772f3aae19240f7bf4a1d1b93, NAME => 'testtb-testConsecutiveExports,1,1695376868366.a733fbb772f3aae19240f7bf4a1d1b93.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 10:01:37,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-22 10:01:37,867 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376897867"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:37,869 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-22 10:01:37,870 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 10:01:37,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-09-22 10:01:37,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-22 10:01:37,941 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-22 10:01:37,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-22 10:01:37,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-22 10:01:37,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-09-22 10:01:37,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-22 10:01:37,975 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=757 (was 770), OpenFileDescriptor=907 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 260), ProcessCount=169 (was 169), AvailableMemoryMB=6693 (was 6844) 2023-09-22 10:01:37,975 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-22 10:01:37,994 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=169, AvailableMemoryMB=6692 2023-09-22 10:01:37,994 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-22 10:01:37,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 10:01:37,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:37,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:01:37,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-22 10:01:38,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:01:38,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 10:01:38,002 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,002 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,003 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f empty. 2023-09-22 10:01:38,003 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d empty. 2023-09-22 10:01:38,003 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,003 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,003 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-22 10:01:38,014 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-22 10:01:38,015 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba6b50d28b35b5c74fa3fa14cc12c25f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:38,015 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7ef9b6ef2067248c3fd537012fad084d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:38,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ba6b50d28b35b5c74fa3fa14cc12c25f, disabling compactions & flushes 2023-09-22 10:01:38,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. after waiting 0 ms 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ba6b50d28b35b5c74fa3fa14cc12c25f: 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 7ef9b6ef2067248c3fd537012fad084d, disabling compactions & flushes 2023-09-22 10:01:38,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. after waiting 0 ms 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 7ef9b6ef2067248c3fd537012fad084d: 2023-09-22 10:01:38,040 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:01:38,041 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376898041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376898041"}]},"ts":"1695376898041"} 2023-09-22 10:01:38,041 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376898041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376898041"}]},"ts":"1695376898041"} 2023-09-22 10:01:38,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:01:38,049 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:01:38,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376898049"}]},"ts":"1695376898049"} 2023-09-22 10:01:38,051 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-22 10:01:38,053 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:01:38,055 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:01:38,055 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:01:38,055 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:01:38,055 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:01:38,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, ASSIGN}] 2023-09-22 10:01:38,057 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, ASSIGN 2023-09-22 10:01:38,058 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, ASSIGN 2023-09-22 10:01:38,058 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:01:38,058 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44903,1695376830088; forceNewPlan=false, retain=false 2023-09-22 10:01:38,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 10:01:38,208 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:01:38,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ba6b50d28b35b5c74fa3fa14cc12c25f, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,215 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=7ef9b6ef2067248c3fd537012fad084d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376898215"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376898215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376898215"}]},"ts":"1695376898215"} 2023-09-22 10:01:38,216 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376898215"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376898215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376898215"}]},"ts":"1695376898215"} 2023-09-22 10:01:38,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure ba6b50d28b35b5c74fa3fa14cc12c25f, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:01:38,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 7ef9b6ef2067248c3fd537012fad084d, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:38,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 10:01:38,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba6b50d28b35b5c74fa3fa14cc12c25f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 10:01:38,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. service=AccessControlService 2023-09-22 10:01:38,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ef9b6ef2067248c3fd537012fad084d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 10:01:38,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. service=AccessControlService 2023-09-22 10:01:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:38,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:38,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,381 INFO [StoreOpener-7ef9b6ef2067248c3fd537012fad084d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,381 INFO [StoreOpener-ba6b50d28b35b5c74fa3fa14cc12c25f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,383 DEBUG [StoreOpener-7ef9b6ef2067248c3fd537012fad084d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf 2023-09-22 10:01:38,383 DEBUG [StoreOpener-7ef9b6ef2067248c3fd537012fad084d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf 2023-09-22 10:01:38,383 DEBUG [StoreOpener-ba6b50d28b35b5c74fa3fa14cc12c25f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf 2023-09-22 10:01:38,383 DEBUG [StoreOpener-ba6b50d28b35b5c74fa3fa14cc12c25f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf 2023-09-22 10:01:38,385 INFO [StoreOpener-ba6b50d28b35b5c74fa3fa14cc12c25f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba6b50d28b35b5c74fa3fa14cc12c25f columnFamilyName cf 2023-09-22 10:01:38,385 INFO [StoreOpener-7ef9b6ef2067248c3fd537012fad084d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ef9b6ef2067248c3fd537012fad084d columnFamilyName cf 2023-09-22 10:01:38,386 INFO [StoreOpener-7ef9b6ef2067248c3fd537012fad084d-1] regionserver.HStore(310): Store=7ef9b6ef2067248c3fd537012fad084d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:38,386 INFO [StoreOpener-ba6b50d28b35b5c74fa3fa14cc12c25f-1] regionserver.HStore(310): Store=ba6b50d28b35b5c74fa3fa14cc12c25f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:38,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:38,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:38,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:38,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:38,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ba6b50d28b35b5c74fa3fa14cc12c25f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66858611, jitterRate=-0.0037290602922439575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:38,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 7ef9b6ef2067248c3fd537012fad084d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68576139, jitterRate=0.02186410129070282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:38,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ba6b50d28b35b5c74fa3fa14cc12c25f: 2023-09-22 10:01:38,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 7ef9b6ef2067248c3fd537012fad084d: 2023-09-22 10:01:38,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d., pid=61, masterSystemTime=1695376898373 2023-09-22 10:01:38,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f., pid=60, masterSystemTime=1695376898372 2023-09-22 10:01:38,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,398 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=7ef9b6ef2067248c3fd537012fad084d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,399 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376898398"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376898398"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376898398"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376898398"}]},"ts":"1695376898398"} 2023-09-22 10:01:38,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ba6b50d28b35b5c74fa3fa14cc12c25f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,399 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376898399"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376898399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376898399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376898399"}]},"ts":"1695376898399"} 2023-09-22 10:01:38,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-22 10:01:38,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 7ef9b6ef2067248c3fd537012fad084d, server=jenkins-hbase17.apache.org,32793,1695376830043 in 179 msec 2023-09-22 10:01:38,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-22 10:01:38,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure ba6b50d28b35b5c74fa3fa14cc12c25f, server=jenkins-hbase17.apache.org,44903,1695376830088 in 181 msec 2023-09-22 10:01:38,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, ASSIGN in 348 msec 2023-09-22 10:01:38,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-22 10:01:38,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, ASSIGN in 348 msec 2023-09-22 10:01:38,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:01:38,405 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376898405"}]},"ts":"1695376898405"} 2023-09-22 10:01:38,407 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-22 10:01:38,408 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:01:38,409 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-22 10:01:38,411 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 10:01:38,412 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:38,412 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:38,412 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:38,412 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:38,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:38,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:38,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:38,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:38,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 417 msec 2023-09-22 10:01:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 10:01:38,607 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-22 10:01:38,612 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,612 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,615 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:01:38,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 10:01:38,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376898633 (current time:1695376898633). 2023-09-22 10:01:38,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:38,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x3e3f096e to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:38,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@674f408, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:38,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:38,644 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:38,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e3f096e to 127.0.0.1:49896 2023-09-22 10:01:38,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x14970431 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:38,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a50bb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:38,654 DEBUG [hconnection-0x7350615c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:38,657 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:38,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14970431 to 127.0.0.1:49896 2023-09-22 10:01:38,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:38,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 10:01:38,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:38,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 10:01:38,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 10:01:38,667 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 10:01:38,668 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695377498668 2023-09-22 10:01:38,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 10:01:38,670 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:38,670 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:38,671 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 10:01:38,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 10:01:38,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-22 10:01:38,673 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 10:01:38,673 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695377498673 2023-09-22 10:01:38,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,687 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-22 10:01:38,687 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,688 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-22 10:01:38,688 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-22 10:01:38,689 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,689 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,690 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,690 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,690 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,690 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,690 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,690 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,691 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 10:01:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 10:01:38,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,691 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,692 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 10:01:38,693 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,692 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,694 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 10:01:38,693 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 10:01:38,695 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 10:01:38,696 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,697 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,697 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,697 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,697 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,697 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,697 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,697 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,698 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:38,697 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,698 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@601fac3d[Count = 1] remaining members to acquire global barrier 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 10:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@601fac3d[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:38,702 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-22 10:01:38,702 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 10:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 10:01:38,703 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 10:01:38,703 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,703 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:38,703 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 10:01:38,703 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:38,704 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:38,704 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:38,704 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,703 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,704 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. started... 2023-09-22 10:01:38,704 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:38,704 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,704 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:38,704 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. started... 2023-09-22 10:01:38,704 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba6b50d28b35b5c74fa3fa14cc12c25f: 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ef9b6ef2067248c3fd537012fad084d: 2023-09-22 10:01:38,706 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:38,706 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,706 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:01:38,706 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:01:38,719 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. completed. 2023-09-22 10:01:38,719 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,719 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:38,720 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. completed. 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,720 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 10:01:38,720 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:38,721 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 10:01:38,721 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,721 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 10:01:38,721 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,721 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,721 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,721 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 10:01:38,722 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 10:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:01:38,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-22 10:01:38,729 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-22 10:01:38,729 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:38,729 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:38,729 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,729 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:38,730 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,730 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,730 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,730 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,730 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,730 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,731 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,731 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,731 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,731 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,734 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,734 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,735 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,737 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,737 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,739 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,739 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,739 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,740 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:01:38,740 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,740 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,740 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 10:01:38,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-22 10:01:38,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,770 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695376898668Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695376898750 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695376898750Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695376898750Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695376898753 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695376898763 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695376898769 (+6 ms) 2023-09-22 10:01:38,771 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:38,772 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 10:01:38,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 10:01:38,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:38,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 103 msec 2023-09-22 10:01:38,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:01:38,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32793] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:01:38,780 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,780 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,780 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:01:38,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 10:01:38,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376898790 (current time:1695376898790). 2023-09-22 10:01:38,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:38,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x24717390 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:38,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3859b58f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:38,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:38,800 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:38,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24717390 to 127.0.0.1:49896 2023-09-22 10:01:38,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:38,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x50056b8e to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:38,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fc77fed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:38,810 DEBUG [hconnection-0xac74857-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:38,814 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:38,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50056b8e to 127.0.0.1:49896 2023-09-22 10:01:38,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:38,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 10:01:38,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:38,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 10:01:38,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 10:01:38,824 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 10:01:38,825 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695377498825 2023-09-22 10:01:38,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 10:01:38,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,827 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:38,827 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:38,829 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 10:01:38,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 10:01:38,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-22 10:01:38,831 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 10:01:38,832 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695377498832 2023-09-22 10:01:38,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,841 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-22 10:01:38,841 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,842 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-22 10:01:38,842 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-22 10:01:38,843 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,843 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,844 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,844 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,844 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,844 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,844 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,844 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,845 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,845 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 10:01:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 10:01:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 10:01:38,846 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 10:01:38,846 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,847 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 10:01:38,847 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 10:01:38,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 10:01:38,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,847 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 10:01:38,849 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 10:01:38,849 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,850 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 10:01:38,850 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 10:01:38,850 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 10:01:38,850 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 10:01:38,851 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:38,852 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 10:01:38,852 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 10:01:38,852 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 10:01:38,852 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,852 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,853 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,853 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 10:01:38,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c71d218[Count = 1] remaining members to acquire global barrier 2023-09-22 10:01:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 10:01:38,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c71d218[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:38,859 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-22 10:01:38,859 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,859 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,859 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,859 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,860 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 10:01:38,860 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,860 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:38,860 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,860 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,860 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 10:01:38,860 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. started... 2023-09-22 10:01:38,860 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 10:01:38,860 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,860 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:38,860 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 10:01:38,861 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ef9b6ef2067248c3fd537012fad084d 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-22 10:01:38,861 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,861 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:38,861 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:38,861 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:38,861 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. started... 2023-09-22 10:01:38,861 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba6b50d28b35b5c74fa3fa14cc12c25f 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-22 10:01:38,862 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 10:01:38,862 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,862 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 10:01:38,881 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309220bcef70290d44d4cb8f17e4ed25f05c5 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309220bcef70290d44d4cb8f17e4ed25f05c5 2023-09-22 10:01:38,882 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092294e34e6f8b8648fb87ab29b1ec860f86 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092294e34e6f8b8648fb87ab29b1ec860f86 2023-09-22 10:01:38,901 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/.tmp/cf/a89d17bfd5c649f890ac1eab4233b493 2023-09-22 10:01:38,901 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/.tmp/cf/6828abbcca274ab1a5b417c1306081f3 2023-09-22 10:01:38,905 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/.tmp/cf/a89d17bfd5c649f890ac1eab4233b493 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf/a89d17bfd5c649f890ac1eab4233b493 2023-09-22 10:01:38,906 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/.tmp/cf/6828abbcca274ab1a5b417c1306081f3 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf/6828abbcca274ab1a5b417c1306081f3 2023-09-22 10:01:38,910 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf/a89d17bfd5c649f890ac1eab4233b493, entries=6, sequenceid=6, filesize=6.0 K 2023-09-22 10:01:38,910 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf/6828abbcca274ab1a5b417c1306081f3, entries=44, sequenceid=6, filesize=13.0 K 2023-09-22 10:01:38,911 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for ba6b50d28b35b5c74fa3fa14cc12c25f in 50ms, sequenceid=6, compaction requested=false 2023-09-22 10:01:38,911 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-22 10:01:38,911 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 7ef9b6ef2067248c3fd537012fad084d in 51ms, sequenceid=6, compaction requested=false 2023-09-22 10:01:38,911 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba6b50d28b35b5c74fa3fa14cc12c25f: 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ef9b6ef2067248c3fd537012fad084d: 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf/6828abbcca274ab1a5b417c1306081f3] hfiles 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf/6828abbcca274ab1a5b417c1306081f3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf/a89d17bfd5c649f890ac1eab4233b493] hfiles 2023-09-22 10:01:38,914 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf/a89d17bfd5c649f890ac1eab4233b493 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,923 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. completed. 2023-09-22 10:01:38,923 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,924 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. completed. 2023-09-22 10:01:38,924 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 10:01:38,924 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:38,925 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 10:01:38,925 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,925 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,925 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 10:01:38,927 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 10:01:38,927 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,927 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,927 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 10:01:38,928 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:38,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 10:01:38,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:01:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,929 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:01:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:38,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-22 10:01:38,934 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-22 10:01:38,934 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:38,934 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:38,934 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,934 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:38,935 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,935 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,936 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,936 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:38,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,937 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,939 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,939 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:38,939 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,942 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,944 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:38,942 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,944 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:38,944 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:38,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-09-22 10:01:38,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:38,944 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:38,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,945 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,945 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:38,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:01:38,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:38,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:38,945 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:38,946 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,946 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092294e34e6f8b8648fb87ab29b1ec860f86, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309220bcef70290d44d4cb8f17e4ed25f05c5] mob files 2023-09-22 10:01:38,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092294e34e6f8b8648fb87ab29b1ec860f86 2023-09-22 10:01:38,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309220bcef70290d44d4cb8f17e4ed25f05c5 2023-09-22 10:01:38,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-22 10:01:38,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,982 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:38,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695376898825Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695376898962 (+137 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695376898962Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695376898962Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695376898967 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695376898974 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695376898980 (+6 ms) 2023-09-22 10:01:38,985 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 10:01:38,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 158 msec 2023-09-22 10:01:39,129 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:39,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 10:01:39,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:39,164 DEBUG [Listener at jenkins-hbase17.apache.org/45039] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 10:01:39,169 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 10:01:39,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32793] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 10:01:39,171 DEBUG [Listener at jenkins-hbase17.apache.org/45039] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 10:01:39,176 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 10:01:39,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41167] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 10:01:39,177 DEBUG [Listener at jenkins-hbase17.apache.org/45039] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 10:01:39,180 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 10:01:39,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 10:01:39,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-22 10:01:39,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:39,186 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:01:39,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-22 10:01:39,187 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:01:39,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 10:01:39,189 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,189 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,190 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 empty. 2023-09-22 10:01:39,190 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 empty. 2023-09-22 10:01:39,190 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,191 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,191 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-22 10:01:39,207 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-22 10:01:39,208 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6dfe554d0ba7dc223edb532918d7fc2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:39,209 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => edf820513e80bd48d9ba06703bb76dc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:39,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:39,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e6dfe554d0ba7dc223edb532918d7fc2, disabling compactions & flushes 2023-09-22 10:01:39,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. after waiting 0 ms 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e6dfe554d0ba7dc223edb532918d7fc2: 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing edf820513e80bd48d9ba06703bb76dc5, disabling compactions & flushes 2023-09-22 10:01:39,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. after waiting 0 ms 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for edf820513e80bd48d9ba06703bb76dc5: 2023-09-22 10:01:39,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:01:39,229 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376899229"}]},"ts":"1695376899229"} 2023-09-22 10:01:39,230 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376899229"}]},"ts":"1695376899229"} 2023-09-22 10:01:39,232 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:01:39,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:01:39,233 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376899233"}]},"ts":"1695376899233"} 2023-09-22 10:01:39,234 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-22 10:01:39,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:01:39,238 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:01:39,238 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:01:39,238 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:01:39,238 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:01:39,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, ASSIGN}] 2023-09-22 10:01:39,241 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, ASSIGN 2023-09-22 10:01:39,241 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, ASSIGN 2023-09-22 10:01:39,242 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41167,1695376829996; forceNewPlan=false, retain=false 2023-09-22 10:01:39,242 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:01:39,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 10:01:39,392 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:01:39,399 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=edf820513e80bd48d9ba06703bb76dc5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:39,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e6dfe554d0ba7dc223edb532918d7fc2, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:39,400 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899399"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376899399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376899399"}]},"ts":"1695376899399"} 2023-09-22 10:01:39,400 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899399"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376899399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376899399"}]},"ts":"1695376899399"} 2023-09-22 10:01:39,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure edf820513e80bd48d9ba06703bb76dc5, server=jenkins-hbase17.apache.org,41167,1695376829996}] 2023-09-22 10:01:39,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure e6dfe554d0ba7dc223edb532918d7fc2, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:39,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 10:01:39,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6dfe554d0ba7dc223edb532918d7fc2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.', STARTKEY => '', ENDKEY => '2'} 2023-09-22 10:01:39,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => edf820513e80bd48d9ba06703bb76dc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.', STARTKEY => '2', ENDKEY => ''} 2023-09-22 10:01:39,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. service=AccessControlService 2023-09-22 10:01:39,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. service=AccessControlService 2023-09-22 10:01:39,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:39,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,568 INFO [StoreOpener-e6dfe554d0ba7dc223edb532918d7fc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,568 INFO [StoreOpener-edf820513e80bd48d9ba06703bb76dc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,569 DEBUG [StoreOpener-e6dfe554d0ba7dc223edb532918d7fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf 2023-09-22 10:01:39,569 DEBUG [StoreOpener-e6dfe554d0ba7dc223edb532918d7fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf 2023-09-22 10:01:39,570 DEBUG [StoreOpener-edf820513e80bd48d9ba06703bb76dc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf 2023-09-22 10:01:39,570 DEBUG [StoreOpener-edf820513e80bd48d9ba06703bb76dc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf 2023-09-22 10:01:39,570 INFO [StoreOpener-e6dfe554d0ba7dc223edb532918d7fc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6dfe554d0ba7dc223edb532918d7fc2 columnFamilyName cf 2023-09-22 10:01:39,570 INFO [StoreOpener-edf820513e80bd48d9ba06703bb76dc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edf820513e80bd48d9ba06703bb76dc5 columnFamilyName cf 2023-09-22 10:01:39,570 INFO [StoreOpener-e6dfe554d0ba7dc223edb532918d7fc2-1] regionserver.HStore(310): Store=e6dfe554d0ba7dc223edb532918d7fc2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:39,570 INFO [StoreOpener-edf820513e80bd48d9ba06703bb76dc5-1] regionserver.HStore(310): Store=edf820513e80bd48d9ba06703bb76dc5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:39,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:39,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:39,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:39,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e6dfe554d0ba7dc223edb532918d7fc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60883511, jitterRate=-0.09276498854160309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:39,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened edf820513e80bd48d9ba06703bb76dc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69764640, jitterRate=0.03957414627075195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:39,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e6dfe554d0ba7dc223edb532918d7fc2: 2023-09-22 10:01:39,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for edf820513e80bd48d9ba06703bb76dc5: 2023-09-22 10:01:39,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2., pid=70, masterSystemTime=1695376899555 2023-09-22 10:01:39,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5., pid=69, masterSystemTime=1695376899555 2023-09-22 10:01:39,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:39,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=edf820513e80bd48d9ba06703bb76dc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:39,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:39,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899578"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376899578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376899578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376899578"}]},"ts":"1695376899578"} 2023-09-22 10:01:39,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e6dfe554d0ba7dc223edb532918d7fc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:39,579 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899578"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376899578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376899578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376899578"}]},"ts":"1695376899578"} 2023-09-22 10:01:39,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-22 10:01:39,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure edf820513e80bd48d9ba06703bb76dc5, server=jenkins-hbase17.apache.org,41167,1695376829996 in 176 msec 2023-09-22 10:01:39,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-22 10:01:39,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure e6dfe554d0ba7dc223edb532918d7fc2, server=jenkins-hbase17.apache.org,32793,1695376830043 in 176 msec 2023-09-22 10:01:39,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, ASSIGN in 343 msec 2023-09-22 10:01:39,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-22 10:01:39,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, ASSIGN in 343 msec 2023-09-22 10:01:39,583 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:01:39,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376899583"}]},"ts":"1695376899583"} 2023-09-22 10:01:39,585 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-22 10:01:39,586 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:01:39,587 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-22 10:01:39,588 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-22 10:01:39,589 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:39,590 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:39,590 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:39,589 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:39,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 407 msec 2023-09-22 10:01:39,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 10:01:39,794 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-22 10:01:39,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions e6dfe554d0ba7dc223edb532918d7fc2, edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:39,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e6dfe554d0ba7dc223edb532918d7fc2, edf820513e80bd48d9ba06703bb76dc5], force=true 2023-09-22 10:01:39,832 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e6dfe554d0ba7dc223edb532918d7fc2, edf820513e80bd48d9ba06703bb76dc5], force=true 2023-09-22 10:01:39,832 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e6dfe554d0ba7dc223edb532918d7fc2, edf820513e80bd48d9ba06703bb76dc5], force=true 2023-09-22 10:01:39,832 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e6dfe554d0ba7dc223edb532918d7fc2, edf820513e80bd48d9ba06703bb76dc5], force=true 2023-09-22 10:01:39,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 10:01:39,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, UNASSIGN}] 2023-09-22 10:01:39,858 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, UNASSIGN 2023-09-22 10:01:39,858 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, UNASSIGN 2023-09-22 10:01:39,859 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=edf820513e80bd48d9ba06703bb76dc5, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:39,859 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e6dfe554d0ba7dc223edb532918d7fc2, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:39,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899859"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376899859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376899859"}]},"ts":"1695376899859"} 2023-09-22 10:01:39,859 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376899859"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376899859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376899859"}]},"ts":"1695376899859"} 2023-09-22 10:01:39,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure edf820513e80bd48d9ba06703bb76dc5, server=jenkins-hbase17.apache.org,41167,1695376829996}] 2023-09-22 10:01:39,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure e6dfe554d0ba7dc223edb532918d7fc2, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:39,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 10:01:40,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:40,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:40,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e6dfe554d0ba7dc223edb532918d7fc2, disabling compactions & flushes 2023-09-22 10:01:40,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:40,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:40,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing edf820513e80bd48d9ba06703bb76dc5, disabling compactions & flushes 2023-09-22 10:01:40,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. after waiting 0 ms 2023-09-22 10:01:40,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:40,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e6dfe554d0ba7dc223edb532918d7fc2 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-22 10:01:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. after waiting 0 ms 2023-09-22 10:01:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:40,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing edf820513e80bd48d9ba06703bb76dc5 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-22 10:01:40,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/.tmp/cf/5fde5c500e7c47a69adf1df10f649185 2023-09-22 10:01:40,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/.tmp/cf/8687e861ff2a480680f58c1f866e126b 2023-09-22 10:01:40,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/.tmp/cf/5fde5c500e7c47a69adf1df10f649185 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf/5fde5c500e7c47a69adf1df10f649185 2023-09-22 10:01:40,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/.tmp/cf/8687e861ff2a480680f58c1f866e126b as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf/8687e861ff2a480680f58c1f866e126b 2023-09-22 10:01:40,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf/5fde5c500e7c47a69adf1df10f649185, entries=1, sequenceid=5, filesize=4.7 K 2023-09-22 10:01:40,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf/8687e861ff2a480680f58c1f866e126b, entries=1, sequenceid=5, filesize=4.7 K 2023-09-22 10:01:40,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e6dfe554d0ba7dc223edb532918d7fc2 in 28ms, sequenceid=5, compaction requested=false 2023-09-22 10:01:40,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 10:01:40,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for edf820513e80bd48d9ba06703bb76dc5 in 27ms, sequenceid=5, compaction requested=false 2023-09-22 10:01:40,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 10:01:40,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-22 10:01:40,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-22 10:01:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:40,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2. 2023-09-22 10:01:40,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5. 2023-09-22 10:01:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e6dfe554d0ba7dc223edb532918d7fc2: 2023-09-22 10:01:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for edf820513e80bd48d9ba06703bb76dc5: 2023-09-22 10:01:40,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:40,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=edf820513e80bd48d9ba06703bb76dc5, regionState=CLOSED 2023-09-22 10:01:40,063 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376900063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376900063"}]},"ts":"1695376900063"} 2023-09-22 10:01:40,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:40,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e6dfe554d0ba7dc223edb532918d7fc2, regionState=CLOSED 2023-09-22 10:01:40,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695376900065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376900065"}]},"ts":"1695376900065"} 2023-09-22 10:01:40,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-22 10:01:40,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure edf820513e80bd48d9ba06703bb76dc5, server=jenkins-hbase17.apache.org,41167,1695376829996 in 206 msec 2023-09-22 10:01:40,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-22 10:01:40,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure e6dfe554d0ba7dc223edb532918d7fc2, server=jenkins-hbase17.apache.org,32793,1695376830043 in 205 msec 2023-09-22 10:01:40,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=edf820513e80bd48d9ba06703bb76dc5, UNASSIGN in 213 msec 2023-09-22 10:01:40,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-22 10:01:40,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e6dfe554d0ba7dc223edb532918d7fc2, UNASSIGN in 216 msec 2023-09-22 10:01:40,111 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-22 10:01:40,113 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899182.e6dfe554d0ba7dc223edb532918d7fc2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:40,113 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695376899182.edf820513e80bd48d9ba06703bb76dc5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:40,113 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:40,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 10:01:40,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, ASSIGN}] 2023-09-22 10:01:40,157 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, ASSIGN 2023-09-22 10:01:40,157 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:01:40,308 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 10:01:40,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f5efc5e6afd6f6f7c0d3f3b06fa3d468, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:40,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695376900311"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376900311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376900311"}]},"ts":"1695376900311"} 2023-09-22 10:01:40,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f5efc5e6afd6f6f7c0d3f3b06fa3d468, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:40,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 10:01:40,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:40,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5efc5e6afd6f6f7c0d3f3b06fa3d468, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.', STARTKEY => '', ENDKEY => ''} 2023-09-22 10:01:40,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. service=AccessControlService 2023-09-22 10:01:40,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:40,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:40,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/.regioninfo 2023-09-22 10:01:40,489 INFO [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,491 DEBUG [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf 2023-09-22 10:01:40,491 DEBUG [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf 2023-09-22 10:01:40,492 INFO [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5efc5e6afd6f6f7c0d3f3b06fa3d468 columnFamilyName cf 2023-09-22 10:01:40,521 DEBUG [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] regionserver.HStore(539): loaded hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/5fde5c500e7c47a69adf1df10f649185.e6dfe554d0ba7dc223edb532918d7fc2->hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf/5fde5c500e7c47a69adf1df10f649185-top 2023-09-22 10:01:40,527 DEBUG [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] regionserver.HStore(539): loaded hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/8687e861ff2a480680f58c1f866e126b.edf820513e80bd48d9ba06703bb76dc5->hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf/8687e861ff2a480680f58c1f866e126b-top 2023-09-22 10:01:40,528 INFO [StoreOpener-f5efc5e6afd6f6f7c0d3f3b06fa3d468-1] regionserver.HStore(310): Store=f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:40,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:40,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f5efc5e6afd6f6f7c0d3f3b06fa3d468; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72880727, jitterRate=0.08600746095180511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f5efc5e6afd6f6f7c0d3f3b06fa3d468: 2023-09-22 10:01:40,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468., pid=77, masterSystemTime=1695376900468 2023-09-22 10:01:40,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.,because compaction is disabled. 2023-09-22 10:01:40,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:40,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:40,536 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f5efc5e6afd6f6f7c0d3f3b06fa3d468, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:40,537 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695376900536"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376900536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376900536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376900536"}]},"ts":"1695376900536"} 2023-09-22 10:01:40,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-22 10:01:40,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f5efc5e6afd6f6f7c0d3f3b06fa3d468, server=jenkins-hbase17.apache.org,32793,1695376830043 in 223 msec 2023-09-22 10:01:40,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-22 10:01:40,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, ASSIGN in 384 msec 2023-09-22 10:01:40,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e6dfe554d0ba7dc223edb532918d7fc2, edf820513e80bd48d9ba06703bb76dc5], force=true in 717 msec 2023-09-22 10:01:40,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 10:01:40,943 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-22 10:01:40,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 10:01:40,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376900946 (current time:1695376900946). 2023-09-22 10:01:40,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:40,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x4035337a to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:40,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6680e6d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:40,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:40,963 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:40,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4035337a to 127.0.0.1:49896 2023-09-22 10:01:40,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:40,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x5299ad28 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:40,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bdeeae2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:40,975 DEBUG [hconnection-0x5a090d0b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:40,980 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:40,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5299ad28 to 127.0.0.1:49896 2023-09-22 10:01:40,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:40,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-22 10:01:40,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:40,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 10:01:40,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 10:01:40,993 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 10:01:40,994 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695377500994 2023-09-22 10:01:40,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:40,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 10:01:40,998 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:40,998 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:40,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 10:01:41,000 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 10:01:41,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-09-22 10:01:41,002 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 10:01:41,003 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695377501003 2023-09-22 10:01:41,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,012 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 10:01:41,012 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:41,014 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-22 10:01:41,014 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-22 10:01:41,014 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,014 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,015 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:41,015 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:41,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:41,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:41,015 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:41,015 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,016 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,016 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 10:01:41,017 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 10:01:41,017 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:41,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 10:01:41,019 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 10:01:41,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,019 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 10:01:41,019 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 10:01:41,019 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 10:01:41,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,019 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:41,019 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 10:01:41,021 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:41,021 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 10:01:41,022 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 10:01:41,022 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 10:01:41,022 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 10:01:41,022 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 10:01:41,022 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 10:01:41,023 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,023 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,023 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:41,023 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,024 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,024 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:41,024 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,024 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:41,024 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,024 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:41,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-22 10:01:41,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d097449[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:41,026 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-22 10:01:41,026 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,027 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:41,027 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 10:01:41,027 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 10:01:41,027 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:41,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:41,028 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 10:01:41,029 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 10:01:41,029 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:41,029 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 10:01:41,035 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:41,038 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:41,038 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:41,039 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. started... 2023-09-22 10:01:41,040 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f5efc5e6afd6f6f7c0d3f3b06fa3d468: 2023-09-22 10:01:41,040 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,040 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:41,040 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/5fde5c500e7c47a69adf1df10f649185.e6dfe554d0ba7dc223edb532918d7fc2->hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf/5fde5c500e7c47a69adf1df10f649185-top, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/8687e861ff2a480680f58c1f866e126b.edf820513e80bd48d9ba06703bb76dc5->hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf/8687e861ff2a480680f58c1f866e126b-top] hfiles 2023-09-22 10:01:41,040 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/5fde5c500e7c47a69adf1df10f649185.e6dfe554d0ba7dc223edb532918d7fc2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,041 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/8687e861ff2a480680f58c1f866e126b.edf820513e80bd48d9ba06703bb76dc5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,048 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. completed. 2023-09-22 10:01:41,048 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:41,048 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:41,048 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:41,048 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,048 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 10:01:41,048 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:41,051 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 10:01:41,051 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:41,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,051 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 10:01:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:41,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-22 10:01:41,054 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-22 10:01:41,054 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:41,054 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:41,054 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,054 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:41,055 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,055 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,055 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,055 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:41,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,055 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,055 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,056 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:41,056 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:41,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:41,057 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,057 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,060 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:41,061 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,061 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,065 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,065 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:41,065 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:41,065 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:41,065 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:41,067 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:41,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,067 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:41,065 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:41,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:41,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:41,067 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:41,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:41,067 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:41,067 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:41,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:41,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:41,068 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:41,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:41,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:41,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-22 10:01:41,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,088 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695376900994Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695376901067 (+73 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695376901067Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695376901070 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695376901080 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695376901087 (+7 ms) 2023-09-22 10:01:41,090 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 10:01:41,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 92 msec 2023-09-22 10:01:41,099 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-22 10:01:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:41,100 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100 2023-09-22 10:01:41,100 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39103, tgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100, rawTgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:41,118 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:41,118 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1159958468_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,118 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-22 10:01:41,127 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:41,149 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,149 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,150 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,150 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0004_000001 (auth:SIMPLE) 2023-09-22 10:01:41,871 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-2547457767138681030.jar 2023-09-22 10:01:41,871 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,871 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,924 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-1661709313346926734.jar 2023-09-22 10:01:41,925 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,925 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,925 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,926 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,926 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,926 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:41,926 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:01:41,927 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:01:41,927 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:01:41,927 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:01:41,928 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:01:41,928 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:01:41,928 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:01:41,928 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:01:41,929 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:01:41,929 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:01:41,929 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:41,930 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:41,930 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:41,930 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:41,931 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:41,931 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:41,932 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:42,268 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:01:42,271 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-22 10:01:42,273 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-22 10:01:42,330 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:42,330 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:42,702 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0005_000001 (auth:SIMPLE) 2023-09-22 10:01:43,270 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:01:46,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0005_000001 (auth:SIMPLE) 2023-09-22 10:01:48,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0005_000001 (auth:SIMPLE) 2023-09-22 10:01:50,795 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0005_000001 (auth:SIMPLE) 2023-09-22 10:01:52,445 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:01:52,448 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:01:52,482 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:52,482 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:01:52,482 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:01:52,483 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:52,483 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-22 10:01:52,483 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-22 10:01:52,483 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:52,483 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-22 10:01:52,483 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376901100/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-22 10:01:52,489 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:52,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 10:01:52,494 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376912494"}]},"ts":"1695376912494"} 2023-09-22 10:01:52,495 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-22 10:01:52,533 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-22 10:01:52,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, UNASSIGN}] 2023-09-22 10:01:52,538 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, UNASSIGN 2023-09-22 10:01:52,540 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f5efc5e6afd6f6f7c0d3f3b06fa3d468, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:52,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695376912540"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376912540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376912540"}]},"ts":"1695376912540"} 2023-09-22 10:01:52,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f5efc5e6afd6f6f7c0d3f3b06fa3d468, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:52,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 10:01:52,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:52,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f5efc5e6afd6f6f7c0d3f3b06fa3d468, disabling compactions & flushes 2023-09-22 10:01:52,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:52,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:52,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. after waiting 0 ms 2023-09-22 10:01:52,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:52,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-22 10:01:52,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:52,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468. 2023-09-22 10:01:52,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f5efc5e6afd6f6f7c0d3f3b06fa3d468: 2023-09-22 10:01:52,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:52,719 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f5efc5e6afd6f6f7c0d3f3b06fa3d468, regionState=CLOSED 2023-09-22 10:01:52,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695376912719"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376912719"}]},"ts":"1695376912719"} 2023-09-22 10:01:52,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-22 10:01:52,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f5efc5e6afd6f6f7c0d3f3b06fa3d468, server=jenkins-hbase17.apache.org,32793,1695376830043 in 177 msec 2023-09-22 10:01:52,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-22 10:01:52,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5efc5e6afd6f6f7c0d3f3b06fa3d468, UNASSIGN in 187 msec 2023-09-22 10:01:52,724 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376912724"}]},"ts":"1695376912724"} 2023-09-22 10:01:52,725 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-22 10:01:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 10:01:52,834 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-22 10:01:52,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 346 msec 2023-09-22 10:01:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 10:01:53,101 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-22 10:01:53,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,107 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,109 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,111 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,112 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,112 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,112 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 10:01:53,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 10:01:53,113 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,113 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-22 10:01:53,113 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 10:01:53,113 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,113 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-22 10:01:53,113 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,113 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,113 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 10:01:53,114 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:53,114 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:53,114 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:53,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:53,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:53,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:53,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-22 10:01:53,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:53,116 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/recovered.edits] 2023-09-22 10:01:53,116 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/recovered.edits] 2023-09-22 10:01:53,117 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/recovered.edits] 2023-09-22 10:01:53,121 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf/8687e861ff2a480680f58c1f866e126b to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/cf/8687e861ff2a480680f58c1f866e126b 2023-09-22 10:01:53,121 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/5fde5c500e7c47a69adf1df10f649185.e6dfe554d0ba7dc223edb532918d7fc2 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/5fde5c500e7c47a69adf1df10f649185.e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:53,121 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf/5fde5c500e7c47a69adf1df10f649185 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/cf/5fde5c500e7c47a69adf1df10f649185 2023-09-22 10:01:53,122 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/8687e861ff2a480680f58c1f866e126b.edf820513e80bd48d9ba06703bb76dc5 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/cf/8687e861ff2a480680f58c1f866e126b.edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:53,123 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/recovered.edits/8.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5/recovered.edits/8.seqid 2023-09-22 10:01:53,124 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/recovered.edits/8.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2/recovered.edits/8.seqid 2023-09-22 10:01:53,124 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/edf820513e80bd48d9ba06703bb76dc5 2023-09-22 10:01:53,124 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e6dfe554d0ba7dc223edb532918d7fc2 2023-09-22 10:01:53,124 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/recovered.edits/12.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468/recovered.edits/12.seqid 2023-09-22 10:01:53,125 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5efc5e6afd6f6f7c0d3f3b06fa3d468 2023-09-22 10:01:53,125 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-22 10:01:53,127 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,128 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-22 10:01:53,130 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-22 10:01:53,131 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,131 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-22 10:01:53,131 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376913131"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:53,133 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-22 10:01:53,133 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f5efc5e6afd6f6f7c0d3f3b06fa3d468, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695376899183.f5efc5e6afd6f6f7c0d3f3b06fa3d468.', STARTKEY => '', ENDKEY => ''}] 2023-09-22 10:01:53,133 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-22 10:01:53,133 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376913133"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:53,134 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-22 10:01:53,135 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-22 10:01:53,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-22 10:01:53,217 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-22 10:01:53,218 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 10:01:53,225 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376913225"}]},"ts":"1695376913225"} 2023-09-22 10:01:53,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-22 10:01:53,228 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-22 10:01:53,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, UNASSIGN}] 2023-09-22 10:01:53,232 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, UNASSIGN 2023-09-22 10:01:53,232 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, UNASSIGN 2023-09-22 10:01:53,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ba6b50d28b35b5c74fa3fa14cc12c25f, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:53,233 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=7ef9b6ef2067248c3fd537012fad084d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:53,233 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376913233"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376913233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376913233"}]},"ts":"1695376913233"} 2023-09-22 10:01:53,233 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376913233"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376913233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376913233"}]},"ts":"1695376913233"} 2023-09-22 10:01:53,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 7ef9b6ef2067248c3fd537012fad084d, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:53,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure ba6b50d28b35b5c74fa3fa14cc12c25f, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:01:53,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 10:01:53,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:53,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:53,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 7ef9b6ef2067248c3fd537012fad084d, disabling compactions & flushes 2023-09-22 10:01:53,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:53,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. after waiting 0 ms 2023-09-22 10:01:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:53,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ba6b50d28b35b5c74fa3fa14cc12c25f, disabling compactions & flushes 2023-09-22 10:01:53,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. after waiting 0 ms 2023-09-22 10:01:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:53,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:01:53,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:01:53,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:53,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d. 2023-09-22 10:01:53,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:01:53,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 7ef9b6ef2067248c3fd537012fad084d: 2023-09-22 10:01:53,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f. 2023-09-22 10:01:53,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ba6b50d28b35b5c74fa3fa14cc12c25f: 2023-09-22 10:01:53,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:53,409 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=7ef9b6ef2067248c3fd537012fad084d, regionState=CLOSED 2023-09-22 10:01:53,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:53,409 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376913409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376913409"}]},"ts":"1695376913409"} 2023-09-22 10:01:53,409 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ba6b50d28b35b5c74fa3fa14cc12c25f, regionState=CLOSED 2023-09-22 10:01:53,409 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695376913409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376913409"}]},"ts":"1695376913409"} 2023-09-22 10:01:53,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-22 10:01:53,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-22 10:01:53,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure ba6b50d28b35b5c74fa3fa14cc12c25f, server=jenkins-hbase17.apache.org,44903,1695376830088 in 176 msec 2023-09-22 10:01:53,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 7ef9b6ef2067248c3fd537012fad084d, server=jenkins-hbase17.apache.org,32793,1695376830043 in 176 msec 2023-09-22 10:01:53,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba6b50d28b35b5c74fa3fa14cc12c25f, UNASSIGN in 184 msec 2023-09-22 10:01:53,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-22 10:01:53,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7ef9b6ef2067248c3fd537012fad084d, UNASSIGN in 184 msec 2023-09-22 10:01:53,415 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376913415"}]},"ts":"1695376913415"} 2023-09-22 10:01:53,416 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-22 10:01:53,417 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-22 10:01:53,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 198 msec 2023-09-22 10:01:53,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 10:01:53,530 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-22 10:01:53,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,542 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,543 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,543 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,543 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,544 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 10:01:53,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 10:01:53,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 10:01:53,544 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,544 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,544 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,544 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,545 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-22 10:01:53,545 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 10:01:53,545 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,545 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:53,545 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:53,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-22 10:01:53,545 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:53,547 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/recovered.edits] 2023-09-22 10:01:53,548 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/recovered.edits] 2023-09-22 10:01:53,551 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf/a89d17bfd5c649f890ac1eab4233b493 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/cf/a89d17bfd5c649f890ac1eab4233b493 2023-09-22 10:01:53,551 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf/6828abbcca274ab1a5b417c1306081f3 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/cf/6828abbcca274ab1a5b417c1306081f3 2023-09-22 10:01:53,553 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f/recovered.edits/9.seqid 2023-09-22 10:01:53,553 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d/recovered.edits/9.seqid 2023-09-22 10:01:53,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba6b50d28b35b5c74fa3fa14cc12c25f 2023-09-22 10:01:53,554 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7ef9b6ef2067248c3fd537012fad084d 2023-09-22 10:01:53,554 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-22 10:01:53,554 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-22 10:01:53,555 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-22 10:01:53,557 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092294e34e6f8b8648fb87ab29b1ec860f86 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092294e34e6f8b8648fb87ab29b1ec860f86 2023-09-22 10:01:53,558 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309220bcef70290d44d4cb8f17e4ed25f05c5 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309220bcef70290d44d4cb8f17e4ed25f05c5 2023-09-22 10:01:53,558 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-22 10:01:53,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,562 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-22 10:01:53,564 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-22 10:01:53,565 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,565 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-22 10:01:53,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376913565"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:53,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376913565"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:53,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 10:01:53,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba6b50d28b35b5c74fa3fa14cc12c25f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695376897996.ba6b50d28b35b5c74fa3fa14cc12c25f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7ef9b6ef2067248c3fd537012fad084d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695376897996.7ef9b6ef2067248c3fd537012fad084d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 10:01:53,567 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-22 10:01:53,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376913567"}]},"ts":"9223372036854775807"} 2023-09-22 10:01:53,568 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-22 10:01:53,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-22 10:01:53,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-22 10:01:53,648 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-22 10:01:53,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-22 10:01:53,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-22 10:01:53,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 10:01:53,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-22 10:01:53,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 10:01:53,704 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 756) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:59348 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:45963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4070 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:46330 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_299820895_1 at /127.0.0.1:46306 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 220), ProcessCount=169 (was 169), AvailableMemoryMB=6616 (was 6692) 2023-09-22 10:01:53,704 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-22 10:01:53,724 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=215, ProcessCount=169, AvailableMemoryMB=6616 2023-09-22 10:01:53,724 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-22 10:01:53,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 10:01:53,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:01:53,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:01:53,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-22 10:01:53,730 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:01:53,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 10:01:53,732 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:53,732 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:53,732 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 empty. 2023-09-22 10:01:53,732 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb empty. 2023-09-22 10:01:53,732 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:53,732 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:53,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-22 10:01:53,740 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-22 10:01:53,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 038baf52cc58c61de086a041ee4db049, NAME => 'testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:53,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d19eaaad3ae2f107ad7103b8c48fbacb, NAME => 'testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:01:53,753 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:53,753 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d19eaaad3ae2f107ad7103b8c48fbacb, disabling compactions & flushes 2023-09-22 10:01:53,753 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:53,753 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:53,753 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. after waiting 0 ms 2023-09-22 10:01:53,753 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:53,753 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:53,753 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d19eaaad3ae2f107ad7103b8c48fbacb: 2023-09-22 10:01:53,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:53,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 038baf52cc58c61de086a041ee4db049, disabling compactions & flushes 2023-09-22 10:01:53,754 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:53,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:53,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. after waiting 0 ms 2023-09-22 10:01:53,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:53,754 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:53,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 038baf52cc58c61de086a041ee4db049: 2023-09-22 10:01:53,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:01:53,757 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376913757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376913757"}]},"ts":"1695376913757"} 2023-09-22 10:01:53,757 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376913757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376913757"}]},"ts":"1695376913757"} 2023-09-22 10:01:53,759 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:01:53,759 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:01:53,760 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376913760"}]},"ts":"1695376913760"} 2023-09-22 10:01:53,761 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-22 10:01:53,763 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:01:53,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:01:53,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:01:53,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:01:53,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:01:53,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, ASSIGN}] 2023-09-22 10:01:53,768 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, ASSIGN 2023-09-22 10:01:53,768 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, ASSIGN 2023-09-22 10:01:53,768 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44903,1695376830088; forceNewPlan=false, retain=false 2023-09-22 10:01:53,768 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:01:53,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 10:01:53,918 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:01:53,921 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=038baf52cc58c61de086a041ee4db049, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:53,921 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d19eaaad3ae2f107ad7103b8c48fbacb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:53,921 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376913921"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376913921"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376913921"}]},"ts":"1695376913921"} 2023-09-22 10:01:53,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376913921"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376913921"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376913921"}]},"ts":"1695376913921"} 2023-09-22 10:01:53,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 038baf52cc58c61de086a041ee4db049, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:01:53,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d19eaaad3ae2f107ad7103b8c48fbacb, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:01:54,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 10:01:54,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d19eaaad3ae2f107ad7103b8c48fbacb, NAME => 'testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 10:01:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 038baf52cc58c61de086a041ee4db049, NAME => 'testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. service=AccessControlService 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. service=AccessControlService 2023-09-22 10:01:54,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:54,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:01:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,086 INFO [StoreOpener-d19eaaad3ae2f107ad7103b8c48fbacb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,086 INFO [StoreOpener-038baf52cc58c61de086a041ee4db049-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,088 DEBUG [StoreOpener-d19eaaad3ae2f107ad7103b8c48fbacb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf 2023-09-22 10:01:54,088 DEBUG [StoreOpener-038baf52cc58c61de086a041ee4db049-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf 2023-09-22 10:01:54,088 DEBUG [StoreOpener-038baf52cc58c61de086a041ee4db049-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf 2023-09-22 10:01:54,088 DEBUG [StoreOpener-d19eaaad3ae2f107ad7103b8c48fbacb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf 2023-09-22 10:01:54,089 INFO [StoreOpener-038baf52cc58c61de086a041ee4db049-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 038baf52cc58c61de086a041ee4db049 columnFamilyName cf 2023-09-22 10:01:54,089 INFO [StoreOpener-d19eaaad3ae2f107ad7103b8c48fbacb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19eaaad3ae2f107ad7103b8c48fbacb columnFamilyName cf 2023-09-22 10:01:54,090 INFO [StoreOpener-038baf52cc58c61de086a041ee4db049-1] regionserver.HStore(310): Store=038baf52cc58c61de086a041ee4db049/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:54,090 INFO [StoreOpener-d19eaaad3ae2f107ad7103b8c48fbacb-1] regionserver.HStore(310): Store=d19eaaad3ae2f107ad7103b8c48fbacb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:01:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 038baf52cc58c61de086a041ee4db049 2023-09-22 10:01:54,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:01:54,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:54,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:01:54,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 038baf52cc58c61de086a041ee4db049; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67237311, jitterRate=0.00191400945186615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:54,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d19eaaad3ae2f107ad7103b8c48fbacb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59573466, jitterRate=-0.11228618025779724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:01:54,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 038baf52cc58c61de086a041ee4db049: 2023-09-22 10:01:54,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d19eaaad3ae2f107ad7103b8c48fbacb: 2023-09-22 10:01:54,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049., pid=93, masterSystemTime=1695376914075 2023-09-22 10:01:54,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb., pid=94, masterSystemTime=1695376914075 2023-09-22 10:01:54,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,103 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d19eaaad3ae2f107ad7103b8c48fbacb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,104 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376914103"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376914103"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376914103"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376914103"}]},"ts":"1695376914103"} 2023-09-22 10:01:54,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,104 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=038baf52cc58c61de086a041ee4db049, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376914104"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376914104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376914104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376914104"}]},"ts":"1695376914104"} 2023-09-22 10:01:54,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-22 10:01:54,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d19eaaad3ae2f107ad7103b8c48fbacb, server=jenkins-hbase17.apache.org,44903,1695376830088 in 181 msec 2023-09-22 10:01:54,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-22 10:01:54,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 038baf52cc58c61de086a041ee4db049, server=jenkins-hbase17.apache.org,32793,1695376830043 in 183 msec 2023-09-22 10:01:54,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, ASSIGN in 341 msec 2023-09-22 10:01:54,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-22 10:01:54,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, ASSIGN in 342 msec 2023-09-22 10:01:54,109 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:01:54,109 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376914109"}]},"ts":"1695376914109"} 2023-09-22 10:01:54,110 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-22 10:01:54,112 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:01:54,112 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-22 10:01:54,113 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 10:01:54,114 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:54,114 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:54,114 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:54,114 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:01:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 10:01:54,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 389 msec 2023-09-22 10:01:54,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 10:01:54,337 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-22 10:01:54,343 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-22 10:01:54,344 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,348 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:01:54,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:01:54,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376914360 (current time:1695376914360). 2023-09-22 10:01:54,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:54,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x2b4a2b1f to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:54,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d63612c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:54,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:54,376 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b4a2b1f to 127.0.0.1:49896 2023-09-22 10:01:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:54,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x0611e195 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:54,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c79209b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:54,388 DEBUG [hconnection-0x5ab54439-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:54,389 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:54,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0611e195 to 127.0.0.1:49896 2023-09-22 10:01:54,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:54,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 10:01:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:01:54,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:01:54,401 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:01:54,402 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695377514402 2023-09-22 10:01:54,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-22 10:01:54,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:01:54,404 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:54,404 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:54,406 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:01:54,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 10:01:54,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-22 10:01:54,410 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 10:01:54,411 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695377514411 2023-09-22 10:01:54,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,420 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-22 10:01:54,420 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,421 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-22 10:01:54,421 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-22 10:01:54,422 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,422 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,424 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,424 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,424 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,424 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,425 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,425 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,426 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 10:01:54,426 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 10:01:54,426 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,426 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,428 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 10:01:54,429 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 10:01:54,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,429 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 10:01:54,429 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 10:01:54,429 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 10:01:54,430 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 10:01:54,429 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 10:01:54,430 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,431 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 10:01:54,431 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 10:01:54,431 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 10:01:54,432 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,432 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,432 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,432 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,432 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,433 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e5ee17e[Count = 1] remaining members to acquire global barrier 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 10:01:54,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e5ee17e[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:54,438 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 10:01:54,438 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,438 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,438 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:01:54,439 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,439 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 10:01:54,439 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:01:54,439 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:01:54,439 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:54,439 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,439 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:54,440 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:54,440 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:54,440 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,440 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. started... 2023-09-22 10:01:54,440 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 10:01:54,440 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,440 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 10:01:54,440 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 038baf52cc58c61de086a041ee4db049: 2023-09-22 10:01:54,440 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,440 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:54,440 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:01:54,445 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:54,446 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,446 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:54,446 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. started... 2023-09-22 10:01:54,447 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d19eaaad3ae2f107ad7103b8c48fbacb: 2023-09-22 10:01:54,447 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,448 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:54,448 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:01:54,453 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. completed. 2023-09-22 10:01:54,453 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,453 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:54,453 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:54,453 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,453 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 10:01:54,453 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:54,454 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 10:01:54,454 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,454 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,454 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 10:01:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,457 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. completed. 2023-09-22 10:01:54,457 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,457 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:54,457 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:54,457 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,457 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 10:01:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,457 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,458 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,458 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 10:01:54,458 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,458 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:01:54,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 10:01:54,463 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-22 10:01:54,463 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:54,463 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:54,463 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,463 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,464 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,465 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,465 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,465 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,467 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,467 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,467 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-22 10:01:54,469 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,469 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:01:54,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 10:01:54,471 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-22 10:01:54,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,500 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695376914402Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695376914478 (+76 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695376914478Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695376914478Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695376914482 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695376914494 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695376914499 (+5 ms) 2023-09-22 10:01:54,503 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 10:01:54,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 99 msec 2023-09-22 10:01:54,506 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:54,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:01:54,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:54,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32793] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:01:54,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:01:54,514 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-22 10:01:54,514 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,514 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:01:54,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:01:54,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376914523 (current time:1695376914523). 2023-09-22 10:01:54,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:01:54,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x0cab4e81 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:54,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c4f57a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:54,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:54,534 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:54,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cab4e81 to 127.0.0.1:49896 2023-09-22 10:01:54,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:54,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x576606a0 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:01:54,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ef958b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:01:54,542 DEBUG [hconnection-0x71b3848-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:01:54,546 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:01:54,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x576606a0 to 127.0.0.1:49896 2023-09-22 10:01:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:01:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 10:01:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:01:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:01:54,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:01:54,557 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:01:54,557 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695377514557 2023-09-22 10:01:54,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 10:01:54,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-22 10:01:54,559 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:01:54,559 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:01:54,563 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 10:01:54,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 10:01:54,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-22 10:01:54,566 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 10:01:54,567 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695377514567 2023-09-22 10:01:54,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,582 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-22 10:01:54,582 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,583 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-22 10:01:54,583 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-22 10:01:54,583 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,583 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,584 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,584 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,584 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,584 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,585 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,585 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 10:01:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 10:01:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 10:01:54,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 10:01:54,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,586 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 10:01:54,586 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,586 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 10:01:54,587 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 10:01:54,587 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 10:01:54,586 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 10:01:54,587 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 10:01:54,587 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,587 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:01:54,588 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 10:01:54,591 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 10:01:54,591 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 10:01:54,591 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 10:01:54,591 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 10:01:54,591 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 10:01:54,592 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,592 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,593 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,593 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,593 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,593 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:54,593 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,594 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,594 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,594 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,594 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@233ddccc[Count = 1] remaining members to acquire global barrier 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 10:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@233ddccc[Count = 0] remaining members to acquire global barrier 2023-09-22 10:01:54,596 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 10:01:54,596 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:01:54,597 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:54,597 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,597 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 10:01:54,597 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. started... 2023-09-22 10:01:54,597 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. started... 2023-09-22 10:01:54,597 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,598 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:01:54,598 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:01:54,598 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 038baf52cc58c61de086a041ee4db049 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-22 10:01:54,597 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:01:54,598 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d19eaaad3ae2f107ad7103b8c48fbacb 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-22 10:01:54,599 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 10:01:54,599 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,599 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 10:01:54,629 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922897cdbedc0874ab08a03b68a9716811d to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922897cdbedc0874ab08a03b68a9716811d 2023-09-22 10:01:54,629 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309228cad0a58b6d8475da555b40a3afe9ebf to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309228cad0a58b6d8475da555b40a3afe9ebf 2023-09-22 10:01:54,643 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/.tmp/cf/f523621d02ae49d2a3a52576a3fdbd65 2023-09-22 10:01:54,644 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/.tmp/cf/afc1bbfec62a498e82c5c880c8878569 2023-09-22 10:01:54,648 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/.tmp/cf/f523621d02ae49d2a3a52576a3fdbd65 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf/f523621d02ae49d2a3a52576a3fdbd65 2023-09-22 10:01:54,649 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/.tmp/cf/afc1bbfec62a498e82c5c880c8878569 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf/afc1bbfec62a498e82c5c880c8878569 2023-09-22 10:01:54,653 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf/afc1bbfec62a498e82c5c880c8878569, entries=2, sequenceid=6, filesize=5.2 K 2023-09-22 10:01:54,653 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf/f523621d02ae49d2a3a52576a3fdbd65, entries=48, sequenceid=6, filesize=13.2 K 2023-09-22 10:01:54,654 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 038baf52cc58c61de086a041ee4db049 in 56ms, sequenceid=6, compaction requested=false 2023-09-22 10:01:54,654 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-22 10:01:54,654 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d19eaaad3ae2f107ad7103b8c48fbacb in 56ms, sequenceid=6, compaction requested=false 2023-09-22 10:01:54,654 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-22 10:01:54,656 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 038baf52cc58c61de086a041ee4db049: 2023-09-22 10:01:54,656 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d19eaaad3ae2f107ad7103b8c48fbacb: 2023-09-22 10:01:54,657 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,657 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,657 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:54,658 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:01:54,658 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf/afc1bbfec62a498e82c5c880c8878569] hfiles 2023-09-22 10:01:54,658 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf/afc1bbfec62a498e82c5c880c8878569 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,658 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf/f523621d02ae49d2a3a52576a3fdbd65] hfiles 2023-09-22 10:01:54,658 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf/f523621d02ae49d2a3a52576a3fdbd65 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,659 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:54,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:01:54,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:01:54,660 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:01:54,666 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. completed. 2023-09-22 10:01:54,666 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:01:54,666 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:54,666 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:54,666 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,666 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 10:01:54,666 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:01:54,667 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. completed. 2023-09-22 10:01:54,667 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:01:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:01:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:01:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 10:01:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,668 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,667 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 10:01:54,668 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 10:01:54,668 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:01:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,670 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 10:01:54,670 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,670 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,670 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 10:01:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:01:54,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 10:01:54,676 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-22 10:01:54,676 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:01:54,676 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:01:54,676 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,676 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:01:54,677 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:01:54,678 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,678 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:01:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:01:54,681 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,681 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,681 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:01:54,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:01:54,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,683 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,683 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:01:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,684 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-22 10:01:54,685 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:01:54,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:01:54,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,685 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:01:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:01:54,685 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:01:54,685 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:01:54,685 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,685 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922897cdbedc0874ab08a03b68a9716811d, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309228cad0a58b6d8475da555b40a3afe9ebf] mob files 2023-09-22 10:01:54,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922897cdbedc0874ab08a03b68a9716811d 2023-09-22 10:01:54,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309228cad0a58b6d8475da555b40a3afe9ebf 2023-09-22 10:01:54,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-22 10:01:54,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,710 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695376914558Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695376914694 (+136 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695376914694Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695376914694Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695376914697 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695376914703 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695376914710 (+7 ms) 2023-09-22 10:01:54,713 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 10:01:54,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 154 msec 2023-09-22 10:01:54,861 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:01:54,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 10:01:54,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:01:54,862 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862 2023-09-22 10:01:54,862 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39103, tgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862, rawTgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:54,885 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:01:54,885 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1491439817_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,886 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-22 10:01:54,891 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:01:54,917 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:54,917 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:54,917 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:54,918 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,618 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-6838843988902948213.jar 2023-09-22 10:01:55,619 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,619 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,672 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-3609287360456865486.jar 2023-09-22 10:01:55,673 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,673 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,673 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,674 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,674 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,674 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:01:55,674 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:01:55,675 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:01:55,675 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:01:55,675 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:01:55,675 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:01:55,676 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:01:55,676 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:01:55,676 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:01:55,677 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:01:55,677 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:01:55,677 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:55,678 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:55,678 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:55,678 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:55,678 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:01:55,679 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:55,679 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:01:56,045 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:01:56,047 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-22 10:01:56,972 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:56,972 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:01:56,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0005_000001 (auth:SIMPLE) 2023-09-22 10:01:57,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0006_000001 (auth:SIMPLE) 2023-09-22 10:01:58,307 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:02:01,136 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0006_000001 (auth:SIMPLE) 2023-09-22 10:02:03,397 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:02:03,397 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:02:03,402 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:02:03,402 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:02:03,402 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:02:03,403 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:02:03,403 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-22 10:02:03,403 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-22 10:02:03,403 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:02:03,403 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-22 10:02:03,403 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376914862/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-22 10:02:03,408 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 10:02:03,413 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376923413"}]},"ts":"1695376923413"} 2023-09-22 10:02:03,414 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-22 10:02:03,415 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-22 10:02:03,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, UNASSIGN}] 2023-09-22 10:02:03,418 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, UNASSIGN 2023-09-22 10:02:03,418 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, UNASSIGN 2023-09-22 10:02:03,419 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d19eaaad3ae2f107ad7103b8c48fbacb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:03,419 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376923419"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376923419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376923419"}]},"ts":"1695376923419"} 2023-09-22 10:02:03,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=038baf52cc58c61de086a041ee4db049, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:03,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376923419"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376923419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376923419"}]},"ts":"1695376923419"} 2023-09-22 10:02:03,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure d19eaaad3ae2f107ad7103b8c48fbacb, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:02:03,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 038baf52cc58c61de086a041ee4db049, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:02:03,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 10:02:03,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:02:03,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d19eaaad3ae2f107ad7103b8c48fbacb, disabling compactions & flushes 2023-09-22 10:02:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:02:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:02:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. after waiting 0 ms 2023-09-22 10:02:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:02:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 038baf52cc58c61de086a041ee4db049 2023-09-22 10:02:03,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 038baf52cc58c61de086a041ee4db049, disabling compactions & flushes 2023-09-22 10:02:03,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:02:03,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:02:03,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. after waiting 0 ms 2023-09-22 10:02:03,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:02:03,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:02:03,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:02:03,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:03,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:03,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049. 2023-09-22 10:02:03,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb. 2023-09-22 10:02:03,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 038baf52cc58c61de086a041ee4db049: 2023-09-22 10:02:03,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d19eaaad3ae2f107ad7103b8c48fbacb: 2023-09-22 10:02:03,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 038baf52cc58c61de086a041ee4db049 2023-09-22 10:02:03,593 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=038baf52cc58c61de086a041ee4db049, regionState=CLOSED 2023-09-22 10:02:03,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:02:03,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376923593"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376923593"}]},"ts":"1695376923593"} 2023-09-22 10:02:03,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d19eaaad3ae2f107ad7103b8c48fbacb, regionState=CLOSED 2023-09-22 10:02:03,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695376923594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376923594"}]},"ts":"1695376923594"} 2023-09-22 10:02:03,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-22 10:02:03,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 038baf52cc58c61de086a041ee4db049, server=jenkins-hbase17.apache.org,32793,1695376830043 in 174 msec 2023-09-22 10:02:03,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-22 10:02:03,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure d19eaaad3ae2f107ad7103b8c48fbacb, server=jenkins-hbase17.apache.org,44903,1695376830088 in 176 msec 2023-09-22 10:02:03,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=038baf52cc58c61de086a041ee4db049, UNASSIGN in 180 msec 2023-09-22 10:02:03,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-22 10:02:03,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d19eaaad3ae2f107ad7103b8c48fbacb, UNASSIGN in 181 msec 2023-09-22 10:02:03,599 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376923599"}]},"ts":"1695376923599"} 2023-09-22 10:02:03,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-22 10:02:03,601 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-22 10:02:03,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 193 msec 2023-09-22 10:02:03,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 10:02:03,718 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-22 10:02:03,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,727 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,728 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,730 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,732 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,732 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,732 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,733 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 10:02:03,733 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,733 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 10:02:03,733 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 10:02:03,733 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,734 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:03,735 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:02:03,735 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:03,734 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:03,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-22 10:02:03,737 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/recovered.edits] 2023-09-22 10:02:03,737 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/recovered.edits] 2023-09-22 10:02:03,741 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf/f523621d02ae49d2a3a52576a3fdbd65 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/cf/f523621d02ae49d2a3a52576a3fdbd65 2023-09-22 10:02:03,741 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf/afc1bbfec62a498e82c5c880c8878569 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/cf/afc1bbfec62a498e82c5c880c8878569 2023-09-22 10:02:03,743 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb/recovered.edits/9.seqid 2023-09-22 10:02:03,743 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049/recovered.edits/9.seqid 2023-09-22 10:02:03,744 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d19eaaad3ae2f107ad7103b8c48fbacb 2023-09-22 10:02:03,744 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testEmptyExportFileSystemState/038baf52cc58c61de086a041ee4db049 2023-09-22 10:02:03,744 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-22 10:02:03,744 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-22 10:02:03,745 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-22 10:02:03,747 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922897cdbedc0874ab08a03b68a9716811d to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922897cdbedc0874ab08a03b68a9716811d 2023-09-22 10:02:03,748 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309228cad0a58b6d8475da555b40a3afe9ebf to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309228cad0a58b6d8475da555b40a3afe9ebf 2023-09-22 10:02:03,749 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-22 10:02:03,751 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,752 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-22 10:02:03,754 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-22 10:02:03,755 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,755 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-22 10:02:03,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376923755"}]},"ts":"9223372036854775807"} 2023-09-22 10:02:03,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376923755"}]},"ts":"9223372036854775807"} 2023-09-22 10:02:03,756 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 10:02:03,756 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 038baf52cc58c61de086a041ee4db049, NAME => 'testtb-testEmptyExportFileSystemState,,1695376913726.038baf52cc58c61de086a041ee4db049.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d19eaaad3ae2f107ad7103b8c48fbacb, NAME => 'testtb-testEmptyExportFileSystemState,1,1695376913726.d19eaaad3ae2f107ad7103b8c48fbacb.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 10:02:03,757 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-22 10:02:03,757 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376923757"}]},"ts":"9223372036854775807"} 2023-09-22 10:02:03,758 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-22 10:02:03,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 10:02:03,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-22 10:02:03,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-22 10:02:03,838 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-22 10:02:03,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-22 10:02:03,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 10:02:03,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-22 10:02:03,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-22 10:02:03,893 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:34801 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:50184 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:59514 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:45227 from appattempt_1695376836352_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:33643 from appattempt_1695376836352_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1327879680_1 at /127.0.0.1:59350 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4838 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1491439817_17 at /127.0.0.1:59368 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 215), ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=6568 (was 6616) 2023-09-22 10:02:03,893 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-22 10:02:03,912 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=214, ProcessCount=170, AvailableMemoryMB=6567 2023-09-22 10:02:03,912 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-22 10:02:03,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 10:02:03,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:03,917 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 10:02:03,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-22 10:02:03,917 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 10:02:03,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 10:02:03,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:03,919 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:03,920 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 empty. 2023-09-22 10:02:03,920 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 empty. 2023-09-22 10:02:03,920 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:03,920 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:03,920 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-22 10:02:03,932 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-22 10:02:03,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e71def390cb315378de3b139dc00f5b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:02:03,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7908a277ba4c680c161c5fe881dea699, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp 2023-09-22 10:02:03,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:02:03,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e71def390cb315378de3b139dc00f5b4, disabling compactions & flushes 2023-09-22 10:02:03,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:03,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:03,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. after waiting 0 ms 2023-09-22 10:02:03,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:03,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:03,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e71def390cb315378de3b139dc00f5b4: 2023-09-22 10:02:03,950 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:02:03,950 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7908a277ba4c680c161c5fe881dea699, disabling compactions & flushes 2023-09-22 10:02:03,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:03,950 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:03,950 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. after waiting 0 ms 2023-09-22 10:02:03,950 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:03,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:03,950 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7908a277ba4c680c161c5fe881dea699: 2023-09-22 10:02:03,952 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 10:02:03,952 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376923952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376923952"}]},"ts":"1695376923952"} 2023-09-22 10:02:03,953 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376923952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376923952"}]},"ts":"1695376923952"} 2023-09-22 10:02:03,954 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 10:02:03,955 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 10:02:03,955 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376923955"}]},"ts":"1695376923955"} 2023-09-22 10:02:03,956 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-22 10:02:03,958 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-22 10:02:03,959 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 10:02:03,959 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 10:02:03,959 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 10:02:03,959 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 10:02:03,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, ASSIGN}] 2023-09-22 10:02:03,962 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, ASSIGN 2023-09-22 10:02:03,962 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, ASSIGN 2023-09-22 10:02:03,962 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44903,1695376830088; forceNewPlan=false, retain=false 2023-09-22 10:02:03,963 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,32793,1695376830043; forceNewPlan=false, retain=false 2023-09-22 10:02:04,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 10:02:04,113 INFO [jenkins-hbase17:45161] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 10:02:04,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e71def390cb315378de3b139dc00f5b4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7908a277ba4c680c161c5fe881dea699, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376924119"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376924119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376924119"}]},"ts":"1695376924119"} 2023-09-22 10:02:04,119 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376924119"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376924119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376924119"}]},"ts":"1695376924119"} 2023-09-22 10:02:04,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure e71def390cb315378de3b139dc00f5b4, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:02:04,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 7908a277ba4c680c161c5fe881dea699, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:02:04,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 10:02:04,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7908a277ba4c680c161c5fe881dea699, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 10:02:04,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e71def390cb315378de3b139dc00f5b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 10:02:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. service=AccessControlService 2023-09-22 10:02:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. service=AccessControlService 2023-09-22 10:02:04,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:02:04,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 10:02:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:02:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 10:02:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,284 INFO [StoreOpener-e71def390cb315378de3b139dc00f5b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,284 INFO [StoreOpener-7908a277ba4c680c161c5fe881dea699-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,286 DEBUG [StoreOpener-e71def390cb315378de3b139dc00f5b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf 2023-09-22 10:02:04,286 DEBUG [StoreOpener-7908a277ba4c680c161c5fe881dea699-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf 2023-09-22 10:02:04,287 DEBUG [StoreOpener-7908a277ba4c680c161c5fe881dea699-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf 2023-09-22 10:02:04,286 DEBUG [StoreOpener-e71def390cb315378de3b139dc00f5b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf 2023-09-22 10:02:04,287 INFO [StoreOpener-e71def390cb315378de3b139dc00f5b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e71def390cb315378de3b139dc00f5b4 columnFamilyName cf 2023-09-22 10:02:04,287 INFO [StoreOpener-7908a277ba4c680c161c5fe881dea699-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7908a277ba4c680c161c5fe881dea699 columnFamilyName cf 2023-09-22 10:02:04,288 INFO [StoreOpener-e71def390cb315378de3b139dc00f5b4-1] regionserver.HStore(310): Store=e71def390cb315378de3b139dc00f5b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:02:04,288 INFO [StoreOpener-7908a277ba4c680c161c5fe881dea699-1] regionserver.HStore(310): Store=7908a277ba4c680c161c5fe881dea699/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 10:02:04,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:04,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:04,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:02:04,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 10:02:04,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 7908a277ba4c680c161c5fe881dea699; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62585016, jitterRate=-0.06741058826446533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:02:04,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 7908a277ba4c680c161c5fe881dea699: 2023-09-22 10:02:04,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e71def390cb315378de3b139dc00f5b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64902772, jitterRate=-0.032873332500457764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 10:02:04,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e71def390cb315378de3b139dc00f5b4: 2023-09-22 10:02:04,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4., pid=108, masterSystemTime=1695376924273 2023-09-22 10:02:04,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699., pid=109, masterSystemTime=1695376924273 2023-09-22 10:02:04,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:04,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:04,296 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e71def390cb315378de3b139dc00f5b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376924296"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376924296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376924296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376924296"}]},"ts":"1695376924296"} 2023-09-22 10:02:04,297 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7908a277ba4c680c161c5fe881dea699, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,297 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376924297"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695376924297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695376924297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695376924297"}]},"ts":"1695376924297"} 2023-09-22 10:02:04,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-22 10:02:04,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure e71def390cb315378de3b139dc00f5b4, server=jenkins-hbase17.apache.org,44903,1695376830088 in 177 msec 2023-09-22 10:02:04,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-22 10:02:04,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 7908a277ba4c680c161c5fe881dea699, server=jenkins-hbase17.apache.org,32793,1695376830043 in 177 msec 2023-09-22 10:02:04,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, ASSIGN in 342 msec 2023-09-22 10:02:04,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-22 10:02:04,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, ASSIGN in 342 msec 2023-09-22 10:02:04,303 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 10:02:04,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376924303"}]},"ts":"1695376924303"} 2023-09-22 10:02:04,304 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-22 10:02:04,306 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 10:02:04,306 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-22 10:02:04,308 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 10:02:04,309 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:04,309 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:04,309 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:04,309 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:04,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 10:02:04,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 10:02:04,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 10:02:04,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 10:02:04,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 396 msec 2023-09-22 10:02:04,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 10:02:04,525 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-22 10:02:04,528 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,528 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,531 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:02:04,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 10:02:04,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376924548 (current time:1695376924548). 2023-09-22 10:02:04,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:02:04,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x7831584d to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:02:04,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@455d29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:02:04,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:02:04,560 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:02:04,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7831584d to 127.0.0.1:49896 2023-09-22 10:02:04,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:04,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x7e5ae2a4 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:02:04,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c5b3e12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:02:04,571 DEBUG [hconnection-0x265d86a5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:02:04,574 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:02:04,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e5ae2a4 to 127.0.0.1:49896 2023-09-22 10:02:04,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:04,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 10:02:04,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:02:04,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 10:02:04,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 10:02:04,585 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 10:02:04,585 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695377524585 2023-09-22 10:02:04,585 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 10:02:04,587 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:02:04,587 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:02:04,589 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 10:02:04,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 10:02:04,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-09-22 10:02:04,591 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 10:02:04,592 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695377524592 2023-09-22 10:02:04,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,605 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-22 10:02:04,605 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,607 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-22 10:02:04,607 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-22 10:02:04,607 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,607 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,610 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,610 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,610 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,610 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,611 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,611 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 10:02:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 10:02:04,614 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,614 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:02:04,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 10:02:04,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 10:02:04,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 10:02:04,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 10:02:04,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,617 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 10:02:04,617 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,617 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 10:02:04,617 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,621 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 10:02:04,621 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 10:02:04,621 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 10:02:04,621 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 10:02:04,621 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 10:02:04,621 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 10:02:04,622 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 10:02:04,622 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,623 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 10:02:04,623 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 10:02:04,623 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 10:02:04,623 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,624 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:02:04,624 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,624 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41be2ba1[Count = 1] remaining members to acquire global barrier 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 10:02:04,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41be2ba1[Count = 0] remaining members to acquire global barrier 2023-09-22 10:02:04,627 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-22 10:02:04,627 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 10:02:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,628 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 10:02:04,628 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 10:02:04,628 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,628 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,628 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 10:02:04,628 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:02:04,629 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:02:04,629 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:02:04,628 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. started... 2023-09-22 10:02:04,629 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:02:04,629 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7908a277ba4c680c161c5fe881dea699: 2023-09-22 10:02:04,629 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,629 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:02:04,629 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:02:04,629 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 10:02:04,629 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:04,629 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 10:02:04,635 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:02:04,636 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:02:04,636 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:04,636 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. started... 2023-09-22 10:02:04,638 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e71def390cb315378de3b139dc00f5b4: 2023-09-22 10:02:04,638 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,638 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:02:04,638 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 10:02:04,653 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. completed. 2023-09-22 10:02:04,653 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,653 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:02:04,653 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:02:04,653 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,653 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 10:02:04,653 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:02:04,655 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,655 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 10:02:04,655 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:04,655 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 10:02:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,657 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. completed. 2023-09-22 10:02:04,657 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:04,657 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:02:04,657 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:02:04,657 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,657 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 10:02:04,657 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:02:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,658 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,658 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 10:02:04,658 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:04,658 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 10:02:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:02:04,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:02:04,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-22 10:02:04,666 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-22 10:02:04,666 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:02:04,666 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:02:04,666 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,666 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:04,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:04,667 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:04,668 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:04,669 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,669 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,670 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,670 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,671 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,672 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,672 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,672 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,672 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,673 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:04,672 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:04,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,673 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:04,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:04,672 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:04,673 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,673 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,674 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,674 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,674 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,674 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,674 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,675 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,675 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:04,675 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,675 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,675 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:04,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:02:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:04,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 10:02:04,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,687 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:02:04,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 10:02:04,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:02:04,689 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:02:04,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-22 10:02:04,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,711 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695376924585Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695376924682 (+97 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695376924682Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695376924682Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695376924689 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695376924705 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695376924710 (+5 ms) 2023-09-22 10:02:04,713 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 10:02:04,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 126 msec 2023-09-22 10:02:04,889 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:02:04,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 10:02:04,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:02:04,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32793] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:02:04,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44903] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 10:02:04,898 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,898 DEBUG [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,899 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 10:02:04,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 10:02:04,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695376924911 (current time:1695376924911). 2023-09-22 10:02:04,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 10:02:04,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x6c14f42d to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:02:04,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26363fa4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:02:04,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:02:04,922 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:02:04,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c14f42d to 127.0.0.1:49896 2023-09-22 10:02:04,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:04,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(139): Connect 0x3bb61b02 to 127.0.0.1:49896 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 10:02:04,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70c835c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 10:02:04,931 DEBUG [hconnection-0x6794ff67-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 10:02:04,932 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 10:02:04,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bb61b02 to 127.0.0.1:49896 2023-09-22 10:02:04,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:04,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 10:02:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 10:02:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 10:02:04,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 10:02:04,943 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 10:02:04,943 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695377524943 2023-09-22 10:02:04,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 10:02:04,945 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 10:02:04,945 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 10:02:04,946 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 10:02:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 10:02:04,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-22 10:02:04,948 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 10:02:04,949 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695377524949 2023-09-22 10:02:04,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,961 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-22 10:02:04,961 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,962 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-22 10:02:04,962 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-22 10:02:04,963 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,963 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,964 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,964 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,964 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,964 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:04,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,964 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,964 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,964 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,964 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 10:02:04,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,965 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 10:02:04,965 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 10:02:04,965 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,965 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,966 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 10:02:04,967 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 10:02:04,967 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 10:02:04,965 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 10:02:04,967 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 10:02:04,967 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 10:02:04,968 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,41167,1695376829996' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 10:02:04,968 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 10:02:04,968 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 10:02:04,968 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 10:02:04,968 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,968 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,970 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:02:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,970 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 10:02:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44903,1695376830088' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2773b4e3[Count = 1] remaining members to acquire global barrier 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:04,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:04,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:04,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,32793,1695376830043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 10:02:04,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2773b4e3[Count = 0] remaining members to acquire global barrier 2023-09-22 10:02:04,974 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-22 10:02:04,974 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 10:02:04,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 10:02:04,975 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:04,975 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 10:02:04,975 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 10:02:04,975 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. started... 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,41167,1695376829996' in zk 2023-09-22 10:02:04,975 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 10:02:04,976 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 10:02:04,976 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7908a277ba4c680c161c5fe881dea699 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-22 10:02:04,976 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:04,976 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. started... 2023-09-22 10:02:04,976 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e71def390cb315378de3b139dc00f5b4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-22 10:02:04,976 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 10:02:04,976 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:04,977 DEBUG [member: 'jenkins-hbase17.apache.org,41167,1695376829996' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 10:02:04,993 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922d0cd76fc02244e3d953a3d335aebe0a9 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922d0cd76fc02244e3d953a3d335aebe0a9 2023-09-22 10:02:04,995 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309224daf8a65a3b24d7ab2961fe061113e20 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309224daf8a65a3b24d7ab2961fe061113e20 2023-09-22 10:02:05,007 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/.tmp/cf/c5cdf324ef764b97bb3a5fb0616d4f1e 2023-09-22 10:02:05,012 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/.tmp/cf/c5cdf324ef764b97bb3a5fb0616d4f1e as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf/c5cdf324ef764b97bb3a5fb0616d4f1e 2023-09-22 10:02:05,017 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf/c5cdf324ef764b97bb3a5fb0616d4f1e, entries=4, sequenceid=6, filesize=5.6 K 2023-09-22 10:02:05,018 INFO [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7908a277ba4c680c161c5fe881dea699 in 42ms, sequenceid=6, compaction requested=false 2023-09-22 10:02:05,018 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-22 10:02:05,019 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7908a277ba4c680c161c5fe881dea699: 2023-09-22 10:02:05,019 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,019 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:02:05,019 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf/c5cdf324ef764b97bb3a5fb0616d4f1e] hfiles 2023-09-22 10:02:05,019 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf/c5cdf324ef764b97bb3a5fb0616d4f1e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,019 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/.tmp/cf/3fed9371e98f4099a397fb45a6b99bbc 2023-09-22 10:02:05,024 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/.tmp/cf/3fed9371e98f4099a397fb45a6b99bbc as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf/3fed9371e98f4099a397fb45a6b99bbc 2023-09-22 10:02:05,028 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf/3fed9371e98f4099a397fb45a6b99bbc, entries=46, sequenceid=6, filesize=13.2 K 2023-09-22 10:02:05,030 INFO [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e71def390cb315378de3b139dc00f5b4 in 54ms, sequenceid=6, compaction requested=false 2023-09-22 10:02:05,032 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e71def390cb315378de3b139dc00f5b4: 2023-09-22 10:02:05,032 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,032 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 10:02:05,032 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf/3fed9371e98f4099a397fb45a6b99bbc] hfiles 2023-09-22 10:02:05,032 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf/3fed9371e98f4099a397fb45a6b99bbc for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,035 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. completed. 2023-09-22 10:02:05,035 DEBUG [rs(jenkins-hbase17.apache.org,32793,1695376830043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:05,035 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:02:05,035 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:02:05,035 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,035 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 10:02:05,035 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,32793,1695376830043' in zk 2023-09-22 10:02:05,036 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 10:02:05,036 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,036 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:05,036 DEBUG [member: 'jenkins-hbase17.apache.org,32793,1695376830043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 10:02:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,040 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. completed. 2023-09-22 10:02:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,040 DEBUG [rs(jenkins-hbase17.apache.org,44903,1695376830088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 10:02:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 10:02:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 10:02:05,040 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44903,1695376830088' in zk 2023-09-22 10:02:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,32793,1695376830043': 2023-09-22 10:02:05,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,32793,1695376830043' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-22 10:02:05,041 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,041 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 10:02:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:05,041 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:05,041 DEBUG [member: 'jenkins-hbase17.apache.org,44903,1695376830088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 10:02:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,44903,1695376830088': 2023-09-22 10:02:05,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44903,1695376830088' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-22 10:02:05,045 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:02:05,045 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-22 10:02:05,045 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 10:02:05,045 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 10:02:05,045 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,045 INFO [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 10:02:05,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 10:02:05,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 10:02:05,046 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 10:02:05,046 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,046 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,046 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 10:02:05,047 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,046 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:05,046 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:05,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:05,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:05,047 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:05,047 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,049 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,049 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 10:02:05,049 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:05,051 DEBUG [(jenkins-hbase17.apache.org,45161,1695376828936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:05,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:05,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:05,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 10:02:05,051 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 10:02:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:05,053 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 10:02:05,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,053 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:05,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 10:02:05,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:05,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:05,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 10:02:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:05,053 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 10:02:05,053 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,053 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309224daf8a65a3b24d7ab2961fe061113e20, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922d0cd76fc02244e3d953a3d335aebe0a9] mob files 2023-09-22 10:02:05,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309224daf8a65a3b24d7ab2961fe061113e20 2023-09-22 10:02:05,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922d0cd76fc02244e3d953a3d335aebe0a9 2023-09-22 10:02:05,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-22 10:02:05,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,077 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695376924943Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695376925061 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695376925062 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695376925062Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695376925065 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695376925071 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695376925077 (+6 ms) 2023-09-22 10:02:05,080 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 10:02:05,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 135 msec 2023-09-22 10:02:05,246 DEBUG [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 10:02:05,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 10:02:05,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 10:02:05,250 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250 2023-09-22 10:02:05,250 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39103, tgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250, rawTgtDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250, srcFsUri=hdfs://localhost:39103, srcDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:02:05,272 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b 2023-09-22 10:02:05,273 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_173016637_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,273 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39103, inputRoot=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b, snapshotDir=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-22 10:02:05,284 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:05,306 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:05,307 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:05,307 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:05,308 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,015 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-1990520233538695501.jar 2023-09-22 10:02:06,015 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,016 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,069 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/hadoop-8653849742033551127.jar 2023-09-22 10:02:06,069 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,069 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,070 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,070 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,070 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,071 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 10:02:06,071 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 10:02:06,071 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 10:02:06,071 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 10:02:06,072 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 10:02:06,072 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 10:02:06,072 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 10:02:06,073 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 10:02:06,073 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 10:02:06,073 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 10:02:06,074 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 10:02:06,074 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:02:06,074 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:02:06,075 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:02:06,075 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:02:06,075 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 10:02:06,076 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:02:06,076 DEBUG [Listener at jenkins-hbase17.apache.org/45039] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 10:02:06,412 WARN [Listener at jenkins-hbase17.apache.org/45039] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 10:02:06,414 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-22 10:02:06,416 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-22 10:02:08,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:02:08,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 10:02:08,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0006_000001 (auth:SIMPLE) 2023-09-22 10:02:08,983 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0007_000001 (auth:SIMPLE) 2023-09-22 10:02:09,163 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:02:12,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0007_000001 (auth:SIMPLE) 2023-09-22 10:02:14,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0007_000001 (auth:SIMPLE) 2023-09-22 10:02:17,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695376836352_0007_000001 (auth:SIMPLE) 2023-09-22 10:02:18,591 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 10:02:18,591 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 10:02:18,600 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,601 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 10:02:18,601 INFO [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 10:02:18,601 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,601 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-22 10:02:18,602 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-22 10:02:18,602 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2101874305_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,602 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-22 10:02:18,602 DEBUG [Listener at jenkins-hbase17.apache.org/45039] snapshot.TestExportSnapshot(367): hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/export-test/export-1695376925250/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-22 10:02:18,608 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 10:02:18,612 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376938612"}]},"ts":"1695376938612"} 2023-09-22 10:02:18,614 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-22 10:02:18,615 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-22 10:02:18,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, UNASSIGN}] 2023-09-22 10:02:18,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, UNASSIGN 2023-09-22 10:02:18,618 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, UNASSIGN 2023-09-22 10:02:18,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7908a277ba4c680c161c5fe881dea699, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:18,619 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e71def390cb315378de3b139dc00f5b4, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:18,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376938619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376938619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376938619"}]},"ts":"1695376938619"} 2023-09-22 10:02:18,619 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376938619"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695376938619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695376938619"}]},"ts":"1695376938619"} 2023-09-22 10:02:18,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 7908a277ba4c680c161c5fe881dea699, server=jenkins-hbase17.apache.org,32793,1695376830043}] 2023-09-22 10:02:18,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure e71def390cb315378de3b139dc00f5b4, server=jenkins-hbase17.apache.org,44903,1695376830088}] 2023-09-22 10:02:18,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 10:02:18,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:18,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 7908a277ba4c680c161c5fe881dea699, disabling compactions & flushes 2023-09-22 10:02:18,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:18,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:18,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. after waiting 0 ms 2023-09-22 10:02:18,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:18,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:18,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e71def390cb315378de3b139dc00f5b4, disabling compactions & flushes 2023-09-22 10:02:18,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:18,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:18,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. after waiting 0 ms 2023-09-22 10:02:18,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:18,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:02:18,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:02:18,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:18,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:18,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699. 2023-09-22 10:02:18,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4. 2023-09-22 10:02:18,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e71def390cb315378de3b139dc00f5b4: 2023-09-22 10:02:18,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 7908a277ba4c680c161c5fe881dea699: 2023-09-22 10:02:18,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:18,796 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7908a277ba4c680c161c5fe881dea699, regionState=CLOSED 2023-09-22 10:02:18,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:18,796 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376938796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376938796"}]},"ts":"1695376938796"} 2023-09-22 10:02:18,796 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e71def390cb315378de3b139dc00f5b4, regionState=CLOSED 2023-09-22 10:02:18,796 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695376938796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695376938796"}]},"ts":"1695376938796"} 2023-09-22 10:02:18,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-22 10:02:18,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 7908a277ba4c680c161c5fe881dea699, server=jenkins-hbase17.apache.org,32793,1695376830043 in 176 msec 2023-09-22 10:02:18,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-22 10:02:18,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure e71def390cb315378de3b139dc00f5b4, server=jenkins-hbase17.apache.org,44903,1695376830088 in 177 msec 2023-09-22 10:02:18,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7908a277ba4c680c161c5fe881dea699, UNASSIGN in 183 msec 2023-09-22 10:02:18,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-22 10:02:18,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e71def390cb315378de3b139dc00f5b4, UNASSIGN in 183 msec 2023-09-22 10:02:18,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695376938801"}]},"ts":"1695376938801"} 2023-09-22 10:02:18,802 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-22 10:02:18,803 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-22 10:02:18,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 195 msec 2023-09-22 10:02:18,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 10:02:18,917 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-22 10:02:18,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,927 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,928 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41167] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,930 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,930 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,930 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,930 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 10:02:18,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 10:02:18,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 10:02:18,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:18,931 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 10:02:18,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:18,932 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:18,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-22 10:02:18,934 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/recovered.edits] 2023-09-22 10:02:18,934 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf, FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/recovered.edits] 2023-09-22 10:02:18,938 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf/c5cdf324ef764b97bb3a5fb0616d4f1e to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/cf/c5cdf324ef764b97bb3a5fb0616d4f1e 2023-09-22 10:02:18,938 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf/3fed9371e98f4099a397fb45a6b99bbc to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/cf/3fed9371e98f4099a397fb45a6b99bbc 2023-09-22 10:02:18,940 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699/recovered.edits/9.seqid 2023-09-22 10:02:18,940 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/recovered.edits/9.seqid to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4/recovered.edits/9.seqid 2023-09-22 10:02:18,940 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7908a277ba4c680c161c5fe881dea699 2023-09-22 10:02:18,941 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e71def390cb315378de3b139dc00f5b4 2023-09-22 10:02:18,941 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-22 10:02:18,941 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-22 10:02:18,942 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-22 10:02:18,944 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309224daf8a65a3b24d7ab2961fe061113e20 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309224daf8a65a3b24d7ab2961fe061113e20 2023-09-22 10:02:18,945 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922d0cd76fc02244e3d953a3d335aebe0a9 to hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922d0cd76fc02244e3d953a3d335aebe0a9 2023-09-22 10:02:18,946 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-22 10:02:18,947 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,949 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-22 10:02:18,951 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-22 10:02:18,952 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,952 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-22 10:02:18,952 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376938952"}]},"ts":"9223372036854775807"} 2023-09-22 10:02:18,952 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695376938952"}]},"ts":"9223372036854775807"} 2023-09-22 10:02:18,954 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 10:02:18,954 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7908a277ba4c680c161c5fe881dea699, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695376923914.7908a277ba4c680c161c5fe881dea699.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e71def390cb315378de3b139dc00f5b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695376923914.e71def390cb315378de3b139dc00f5b4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 10:02:18,954 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-22 10:02:18,954 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695376938954"}]},"ts":"9223372036854775807"} 2023-09-22 10:02:18,955 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-22 10:02:18,956 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:18,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-09-22 10:02:19,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-22 10:02:19,034 INFO [Listener at jenkins-hbase17.apache.org/45039] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-22 10:02:19,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-22 10:02:19,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:19,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-22 10:02:19,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45161] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 10:02:19,075 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 764) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-672193593_17 at /127.0.0.1:38910 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-658689758_1 at /127.0.0.1:59572 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:59606 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2101874305_17 at /127.0.0.1:58774 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5447 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a910faf-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase17.apache.org/136.243.18.41:40159 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 214), ProcessCount=170 (was 170), AvailableMemoryMB=6452 (was 6567) 2023-09-22 10:02:19,076 WARN [Listener at jenkins-hbase17.apache.org/45039] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-22 10:02:19,076 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-22 10:02:19,088 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-22 10:02:19,205 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695376836352_0007_01_000001 is : 143 2023-09-22 10:02:24,364 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 10:02:33,231 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-22 10:02:47,359 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 10:02:47,360 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-22 10:02:47,472 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-22 10:02:47,481 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-22 10:02:47,482 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 10:02:47,492 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-22 10:02:47,598 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 10:02:47,598 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-22 10:02:47,598 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-22 10:02:47,598 INFO [Listener at jenkins-hbase17.apache.org/45039] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-22 10:02:47,599 DEBUG [Listener at jenkins-hbase17.apache.org/45039] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f1e3164 to 127.0.0.1:49896 2023-09-22 10:02:47,599 DEBUG [Listener at jenkins-hbase17.apache.org/45039] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,599 DEBUG [Listener at jenkins-hbase17.apache.org/45039] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-22 10:02:47,599 DEBUG [Listener at jenkins-hbase17.apache.org/45039] util.JVMClusterUtil(257): Found active master hash=460746640, stopped=false 2023-09-22 10:02:47,600 DEBUG [Listener at jenkins-hbase17.apache.org/45039] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,600 DEBUG [Listener at jenkins-hbase17.apache.org/45039] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-22 10:02:47,600 INFO [Listener at jenkins-hbase17.apache.org/45039] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:02:47,601 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 10:02:47,601 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 10:02:47,602 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 10:02:47,602 INFO [Listener at jenkins-hbase17.apache.org/45039] procedure2.ProcedureExecutor(628): Stopping 2023-09-22 10:02:47,602 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:02:47,601 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 10:02:47,602 DEBUG [Listener at jenkins-hbase17.apache.org/45039] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b1825c3 to 127.0.0.1:49896 2023-09-22 10:02:47,602 DEBUG [Listener at jenkins-hbase17.apache.org/45039] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:02:47,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:02:47,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:02:47,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 10:02:47,603 INFO [Listener at jenkins-hbase17.apache.org/45039] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,41167,1695376829996' ***** 2023-09-22 10:02:47,604 DEBUG [Listener at jenkins-hbase17.apache.org/45039] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,604 INFO [Listener at jenkins-hbase17.apache.org/45039] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 10:02:47,604 INFO [Listener at jenkins-hbase17.apache.org/45039] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,32793,1695376830043' ***** 2023-09-22 10:02:47,604 DEBUG [Listener at jenkins-hbase17.apache.org/45039] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,604 INFO [RS:0;jenkins-hbase17:41167] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 10:02:47,604 INFO [Listener at jenkins-hbase17.apache.org/45039] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 10:02:47,605 INFO [RS:0;jenkins-hbase17:41167] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 10:02:47,605 INFO [Listener at jenkins-hbase17.apache.org/45039] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44903,1695376830088' ***** 2023-09-22 10:02:47,605 INFO [RS:1;jenkins-hbase17:32793] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 10:02:47,605 DEBUG [Listener at jenkins-hbase17.apache.org/45039] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,605 INFO [Listener at jenkins-hbase17.apache.org/45039] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 10:02:47,605 INFO [RS:0;jenkins-hbase17:41167] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 10:02:47,605 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 10:02:47,605 INFO [RS:2;jenkins-hbase17:44903] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 10:02:47,605 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 10:02:47,606 INFO [RS:2;jenkins-hbase17:44903] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 10:02:47,606 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(3305): Received CLOSE for 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:02:47,605 INFO [RS:1;jenkins-hbase17:32793] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 10:02:47,606 INFO [RS:2;jenkins-hbase17:44903] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 10:02:47,606 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 10:02:47,606 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:47,606 INFO [RS:1;jenkins-hbase17:32793] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 10:02:47,606 DEBUG [RS:2;jenkins-hbase17:44903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fa7ac0a to 127.0.0.1:49896 2023-09-22 10:02:47,606 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:47,606 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(3305): Received CLOSE for 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:02:47,606 DEBUG [RS:2;jenkins-hbase17:44903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,607 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:47,607 DEBUG [RS:0;jenkins-hbase17:41167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309db57c to 127.0.0.1:49896 2023-09-22 10:02:47,608 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44903,1695376830088; all regions closed. 2023-09-22 10:02:47,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 43cfd74c65f8f0a18e3a692d54c55a58, disabling compactions & flushes 2023-09-22 10:02:47,608 DEBUG [RS:0;jenkins-hbase17:41167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0050752c68fd2dfe558e13d2c289a2a8, disabling compactions & flushes 2023-09-22 10:02:47,608 DEBUG [RS:1;jenkins-hbase17:32793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x625fb3cc to 127.0.0.1:49896 2023-09-22 10:02:47,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:02:47,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:02:47,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. after waiting 0 ms 2023-09-22 10:02:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:02:47,609 INFO [RS:0;jenkins-hbase17:41167] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 10:02:47,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:02:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:02:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. after waiting 0 ms 2023-09-22 10:02:47,610 INFO [RS:0;jenkins-hbase17:41167] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 10:02:47,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 0050752c68fd2dfe558e13d2c289a2a8 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-22 10:02:47,609 DEBUG [RS:1;jenkins-hbase17:32793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,610 INFO [RS:0;jenkins-hbase17:41167] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 10:02:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:02:47,610 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-22 10:02:47,610 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-22 10:02:47,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 43cfd74c65f8f0a18e3a692d54c55a58 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-22 10:02:47,610 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1478): Online Regions={0050752c68fd2dfe558e13d2c289a2a8=hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8.} 2023-09-22 10:02:47,611 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-22 10:02:47,611 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 43cfd74c65f8f0a18e3a692d54c55a58=hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58.} 2023-09-22 10:02:47,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-22 10:02:47,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-22 10:02:47,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-22 10:02:47,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-22 10:02:47,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-22 10:02:47,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-22 10:02:47,612 DEBUG [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1504): Waiting on 1588230740, 43cfd74c65f8f0a18e3a692d54c55a58 2023-09-22 10:02:47,612 DEBUG [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1504): Waiting on 0050752c68fd2dfe558e13d2c289a2a8 2023-09-22 10:02:47,626 DEBUG [RS:2;jenkins-hbase17:44903] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs 2023-09-22 10:02:47,626 INFO [RS:2;jenkins-hbase17:44903] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44903%2C1695376830088:(num 1695376831645) 2023-09-22 10:02:47,626 DEBUG [RS:2;jenkins-hbase17:44903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,626 INFO [RS:2;jenkins-hbase17:44903] regionserver.LeaseManager(133): Closed leases 2023-09-22 10:02:47,627 INFO [RS:2;jenkins-hbase17:44903] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-22 10:02:47,627 INFO [RS:2;jenkins-hbase17:44903] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 10:02:47,627 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 10:02:47,627 INFO [RS:2;jenkins-hbase17:44903] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 10:02:47,627 INFO [RS:2;jenkins-hbase17:44903] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 10:02:47,641 INFO [RS:2;jenkins-hbase17:44903] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44903 2023-09-22 10:02:47,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/.tmp/l/08db905f2dd149d89e4c2231d6102a18 2023-09-22 10:02:47,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/.tmp/info/233eb5789b894b03a58ff417f0333d8a 2023-09-22 10:02:47,654 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:47,654 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:47,654 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44903,1695376830088 2023-09-22 10:02:47,656 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:02:47,656 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:02:47,656 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:02:47,656 ERROR [Listener at localhost/46713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25d22aa8 rejected from java.util.concurrent.ThreadPoolExecutor@21edaaca[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 108] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-09-22 10:02:47,656 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:02:47,657 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,44903,1695376830088] 2023-09-22 10:02:47,658 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,44903,1695376830088; numProcessing=1 2023-09-22 10:02:47,659 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,44903,1695376830088 already deleted, retry=false 2023-09-22 10:02:47,659 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,44903,1695376830088 expired; onlineServers=2 2023-09-22 10:02:47,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/.tmp/info/1ef90cb3459642d5bdeefc96e8b783a6 2023-09-22 10:02:47,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08db905f2dd149d89e4c2231d6102a18 2023-09-22 10:02:47,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/.tmp/l/08db905f2dd149d89e4c2231d6102a18 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/l/08db905f2dd149d89e4c2231d6102a18 2023-09-22 10:02:47,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/.tmp/info/233eb5789b894b03a58ff417f0333d8a as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/info/233eb5789b894b03a58ff417f0333d8a 2023-09-22 10:02:47,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ef90cb3459642d5bdeefc96e8b783a6 2023-09-22 10:02:47,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08db905f2dd149d89e4c2231d6102a18 2023-09-22 10:02:47,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/l/08db905f2dd149d89e4c2231d6102a18, entries=7, sequenceid=18, filesize=5.2 K 2023-09-22 10:02:47,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 43cfd74c65f8f0a18e3a692d54c55a58 in 57ms, sequenceid=18, compaction requested=false 2023-09-22 10:02:47,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/info/233eb5789b894b03a58ff417f0333d8a, entries=2, sequenceid=6, filesize=4.8 K 2023-09-22 10:02:47,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0050752c68fd2dfe558e13d2c289a2a8 in 63ms, sequenceid=6, compaction requested=false 2023-09-22 10:02:47,682 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 10:02:47,682 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 10:02:47,682 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 10:02:47,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/acl/43cfd74c65f8f0a18e3a692d54c55a58/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-22 10:02:47,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/namespace/0050752c68fd2dfe558e13d2c289a2a8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 10:02:47,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:02:47,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 43cfd74c65f8f0a18e3a692d54c55a58: 2023-09-22 10:02:47,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:02:47,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0050752c68fd2dfe558e13d2c289a2a8: 2023-09-22 10:02:47,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695376832778.43cfd74c65f8f0a18e3a692d54c55a58. 2023-09-22 10:02:47,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695376832044.0050752c68fd2dfe558e13d2c289a2a8. 2023-09-22 10:02:47,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/.tmp/rep_barrier/37b8fc3603b84b0cbbea1e851cef2893 2023-09-22 10:02:47,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37b8fc3603b84b0cbbea1e851cef2893 2023-09-22 10:02:47,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/.tmp/table/61a2d22c71f34463b731071835fbfa2f 2023-09-22 10:02:47,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61a2d22c71f34463b731071835fbfa2f 2023-09-22 10:02:47,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/.tmp/info/1ef90cb3459642d5bdeefc96e8b783a6 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/info/1ef90cb3459642d5bdeefc96e8b783a6 2023-09-22 10:02:47,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ef90cb3459642d5bdeefc96e8b783a6 2023-09-22 10:02:47,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/info/1ef90cb3459642d5bdeefc96e8b783a6, entries=48, sequenceid=131, filesize=10.3 K 2023-09-22 10:02:47,719 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/.tmp/rep_barrier/37b8fc3603b84b0cbbea1e851cef2893 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/rep_barrier/37b8fc3603b84b0cbbea1e851cef2893 2023-09-22 10:02:47,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37b8fc3603b84b0cbbea1e851cef2893 2023-09-22 10:02:47,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/rep_barrier/37b8fc3603b84b0cbbea1e851cef2893, entries=13, sequenceid=131, filesize=6.4 K 2023-09-22 10:02:47,724 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/.tmp/table/61a2d22c71f34463b731071835fbfa2f as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/table/61a2d22c71f34463b731071835fbfa2f 2023-09-22 10:02:47,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61a2d22c71f34463b731071835fbfa2f 2023-09-22 10:02:47,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/table/61a2d22c71f34463b731071835fbfa2f, entries=24, sequenceid=131, filesize=6.9 K 2023-09-22 10:02:47,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 117ms, sequenceid=131, compaction requested=false 2023-09-22 10:02:47,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-22 10:02:47,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 10:02:47,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-22 10:02:47,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-22 10:02:47,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-22 10:02:47,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-22 10:02:47,757 INFO [RS:2;jenkins-hbase17:44903] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44903,1695376830088; zookeeper connection closed. 2023-09-22 10:02:47,757 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:47,757 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:44903-0x100d313a1f70003, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:47,757 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30586083] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30586083 2023-09-22 10:02:47,812 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,41167,1695376829996; all regions closed. 2023-09-22 10:02:47,812 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,32793,1695376830043; all regions closed. 2023-09-22 10:02:47,823 DEBUG [RS:1;jenkins-hbase17:32793] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs 2023-09-22 10:02:47,823 DEBUG [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs 2023-09-22 10:02:47,823 INFO [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C41167%2C1695376829996.meta:.meta(num 1695376831773) 2023-09-22 10:02:47,823 INFO [RS:1;jenkins-hbase17:32793] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C32793%2C1695376830043:(num 1695376831645) 2023-09-22 10:02:47,823 DEBUG [RS:1;jenkins-hbase17:32793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,824 INFO [RS:1;jenkins-hbase17:32793] regionserver.LeaseManager(133): Closed leases 2023-09-22 10:02:47,824 INFO [RS:1;jenkins-hbase17:32793] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-22 10:02:47,824 INFO [RS:1;jenkins-hbase17:32793] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 10:02:47,825 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 10:02:47,825 INFO [RS:1;jenkins-hbase17:32793] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 10:02:47,825 INFO [RS:1;jenkins-hbase17:32793] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 10:02:47,825 INFO [RS:1;jenkins-hbase17:32793] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:32793 2023-09-22 10:02:47,827 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:47,827 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:02:47,827 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,32793,1695376830043 2023-09-22 10:02:47,828 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,32793,1695376830043] 2023-09-22 10:02:47,828 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,32793,1695376830043; numProcessing=2 2023-09-22 10:02:47,829 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,32793,1695376830043 already deleted, retry=false 2023-09-22 10:02:47,829 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,32793,1695376830043 expired; onlineServers=1 2023-09-22 10:02:47,830 DEBUG [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/oldWALs 2023-09-22 10:02:47,830 INFO [RS:0;jenkins-hbase17:41167] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C41167%2C1695376829996:(num 1695376831645) 2023-09-22 10:02:47,830 DEBUG [RS:0;jenkins-hbase17:41167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,830 INFO [RS:0;jenkins-hbase17:41167] regionserver.LeaseManager(133): Closed leases 2023-09-22 10:02:47,830 INFO [RS:0;jenkins-hbase17:41167] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-22 10:02:47,830 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 10:02:47,831 INFO [RS:0;jenkins-hbase17:41167] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:41167 2023-09-22 10:02:47,832 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,41167,1695376829996 2023-09-22 10:02:47,832 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 10:02:47,833 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,41167,1695376829996] 2023-09-22 10:02:47,833 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,41167,1695376829996; numProcessing=3 2023-09-22 10:02:47,833 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,41167,1695376829996 already deleted, retry=false 2023-09-22 10:02:47,833 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,41167,1695376829996 expired; onlineServers=0 2023-09-22 10:02:47,833 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,45161,1695376828936' ***** 2023-09-22 10:02:47,833 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-22 10:02:47,833 DEBUG [M:0;jenkins-hbase17:45161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a4b65ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-22 10:02:47,833 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,45161,1695376828936 2023-09-22 10:02:47,834 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,45161,1695376828936; all regions closed. 2023-09-22 10:02:47,834 DEBUG [M:0;jenkins-hbase17:45161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 10:02:47,834 DEBUG [M:0;jenkins-hbase17:45161] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-22 10:02:47,834 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-22 10:02:47,834 DEBUG [M:0;jenkins-hbase17:45161] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-22 10:02:47,834 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1695376831263] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1695376831263,5,FailOnTimeoutGroup] 2023-09-22 10:02:47,834 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1695376831263] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1695376831263,5,FailOnTimeoutGroup] 2023-09-22 10:02:47,834 INFO [M:0;jenkins-hbase17:45161] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-22 10:02:47,834 INFO [M:0;jenkins-hbase17:45161] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-22 10:02:47,834 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-22 10:02:47,834 INFO [M:0;jenkins-hbase17:45161] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-09-22 10:02:47,834 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 10:02:47,834 DEBUG [M:0;jenkins-hbase17:45161] master.HMaster(1512): Stopping service threads 2023-09-22 10:02:47,834 INFO [M:0;jenkins-hbase17:45161] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-22 10:02:47,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 10:02:47,835 ERROR [M:0;jenkins-hbase17:45161] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-22 10:02:47,835 INFO [M:0;jenkins-hbase17:45161] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-22 10:02:47,835 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-22 10:02:47,835 DEBUG [M:0;jenkins-hbase17:45161] zookeeper.ZKUtil(398): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-22 10:02:47,836 WARN [M:0;jenkins-hbase17:45161] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-22 10:02:47,836 INFO [M:0;jenkins-hbase17:45161] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-22 10:02:47,836 INFO [M:0;jenkins-hbase17:45161] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-22 10:02:47,836 DEBUG [M:0;jenkins-hbase17:45161] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-22 10:02:47,836 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:02:47,836 DEBUG [M:0;jenkins-hbase17:45161] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:02:47,837 DEBUG [M:0;jenkins-hbase17:45161] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-22 10:02:47,837 DEBUG [M:0;jenkins-hbase17:45161] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:02:47,837 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.04 KB heapSize=452.31 KB 2023-09-22 10:02:47,852 INFO [M:0;jenkins-hbase17:45161] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.04 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/555de571208441d3bb22ec03c9572f27 2023-09-22 10:02:47,855 INFO [M:0;jenkins-hbase17:45161] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 555de571208441d3bb22ec03c9572f27 2023-09-22 10:02:47,856 DEBUG [M:0;jenkins-hbase17:45161] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/555de571208441d3bb22ec03c9572f27 as hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/555de571208441d3bb22ec03c9572f27 2023-09-22 10:02:47,860 INFO [M:0;jenkins-hbase17:45161] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 555de571208441d3bb22ec03c9572f27 2023-09-22 10:02:47,860 INFO [M:0;jenkins-hbase17:45161] regionserver.HStore(1080): Added hdfs://localhost:39103/user/jenkins/test-data/30f1c0ba-fed9-6260-637e-5286a4abda9b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/555de571208441d3bb22ec03c9572f27, entries=119, sequenceid=899, filesize=28.6 K 2023-09-22 10:02:47,861 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegion(2948): Finished flush of dataSize ~376.04 KB/385069, heapSize ~452.30 KB/463152, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-22 10:02:47,863 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 10:02:47,863 DEBUG [M:0;jenkins-hbase17:45161] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 10:02:47,867 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 10:02:47,867 INFO [M:0;jenkins-hbase17:45161] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-22 10:02:47,868 INFO [M:0;jenkins-hbase17:45161] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:45161 2023-09-22 10:02:47,868 DEBUG [M:0;jenkins-hbase17:45161] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,45161,1695376828936 already deleted, retry=false 2023-09-22 10:02:47,929 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:47,929 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:32793-0x100d313a1f70002, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:47,929 INFO [RS:1;jenkins-hbase17:32793] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,32793,1695376830043; zookeeper connection closed. 2023-09-22 10:02:47,929 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@462c5eaa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@462c5eaa 2023-09-22 10:02:48,029 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:48,029 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): master:45161-0x100d313a1f70000, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:48,029 INFO [M:0;jenkins-hbase17:45161] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,45161,1695376828936; zookeeper connection closed. 2023-09-22 10:02:48,130 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:48,130 INFO [RS:0;jenkins-hbase17:41167] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,41167,1695376829996; zookeeper connection closed. 2023-09-22 10:02:48,130 DEBUG [Listener at localhost/46713-EventThread] zookeeper.ZKWatcher(600): regionserver:41167-0x100d313a1f70001, quorum=127.0.0.1:49896, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 10:02:48,130 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f168d21] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f168d21 2023-09-22 10:02:48,130 INFO [Listener at jenkins-hbase17.apache.org/45039] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-22 10:02:48,131 WARN [Listener at jenkins-hbase17.apache.org/45039] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 10:02:48,135 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 10:02:48,242 WARN [BP-1368691651-136.243.18.41-1695376825633 heartbeating to localhost/127.0.0.1:39103] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 10:02:48,242 WARN [BP-1368691651-136.243.18.41-1695376825633 heartbeating to localhost/127.0.0.1:39103] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1368691651-136.243.18.41-1695376825633 (Datanode Uuid c7d42629-00c4-4538-9e2f-53ee4f01d075) service to localhost/127.0.0.1:39103 2023-09-22 10:02:48,246 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data5/current/BP-1368691651-136.243.18.41-1695376825633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 10:02:48,246 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data6/current/BP-1368691651-136.243.18.41-1695376825633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 10:02:48,247 WARN [Listener at jenkins-hbase17.apache.org/45039] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 10:02:48,251 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 10:02:48,357 WARN [BP-1368691651-136.243.18.41-1695376825633 heartbeating to localhost/127.0.0.1:39103] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 10:02:48,357 WARN [BP-1368691651-136.243.18.41-1695376825633 heartbeating to localhost/127.0.0.1:39103] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1368691651-136.243.18.41-1695376825633 (Datanode Uuid 068fa58a-a51a-40fa-87d1-25f30e7c6c74) service to localhost/127.0.0.1:39103 2023-09-22 10:02:48,360 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data3/current/BP-1368691651-136.243.18.41-1695376825633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 10:02:48,361 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data4/current/BP-1368691651-136.243.18.41-1695376825633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 10:02:48,362 WARN [Listener at jenkins-hbase17.apache.org/45039] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 10:02:48,365 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 10:02:48,467 WARN [BP-1368691651-136.243.18.41-1695376825633 heartbeating to localhost/127.0.0.1:39103] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 10:02:48,467 WARN [BP-1368691651-136.243.18.41-1695376825633 heartbeating to localhost/127.0.0.1:39103] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1368691651-136.243.18.41-1695376825633 (Datanode Uuid 4ab6fb28-339f-48a7-a4cc-caa0ffacb7c0) service to localhost/127.0.0.1:39103 2023-09-22 10:02:48,468 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data1/current/BP-1368691651-136.243.18.41-1695376825633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 10:02:48,468 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e267468-0d30-776c-34e0-a878ef319ff3/cluster_898d7fd3-b703-93ed-0703-7cb51b32ebe4/dfs/data/data2/current/BP-1368691651-136.243.18.41-1695376825633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 10:02:48,488 INFO [Listener at jenkins-hbase17.apache.org/45039] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 10:02:48,617 INFO [Listener at jenkins-hbase17.apache.org/45039] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-22 10:02:48,695 INFO [Listener at jenkins-hbase17.apache.org/45039] hbase.HBaseTestingUtility(1293): Minicluster is down