2023-07-11 21:58:20,003 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-11 21:58:20,343 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068 2023-07-11 21:58:20,343 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-11 21:58:20,420 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 21:58:20,786 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 21:58:20,787 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800, deleteOnExit=true 2023-07-11 21:58:20,788 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 21:58:20,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/test.cache.data in system properties and HBase conf 2023-07-11 21:58:20,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:58:20,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:58:20,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:58:20,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:58:20,791 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:58:21,465 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 21:58:21,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:58:21,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:58:21,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:58:21,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:58:21,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:58:21,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:58:21,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:58:21,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:58:21,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:58:21,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:58:21,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:58:21,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:58:21,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:58:21,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 21:58:22,751 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:58:22,759 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:58:23,377 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 21:58:23,734 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 21:58:23,778 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:23,857 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:23,969 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_localhost_38165_hdfs____9v9wph/webapp 2023-07-11 21:58:24,221 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38165 2023-07-11 21:58:24,239 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:58:24,239 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:58:25,294 WARN [Listener at localhost/41803] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:58:25,507 WARN [Listener at localhost/41803] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:58:25,695 WARN [Listener at localhost/41803] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:25,705 INFO [Listener at localhost/41803] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:25,746 INFO [Listener at localhost/41803] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_localhost_36189_datanode____.3gswyy/webapp 2023-07-11 21:58:25,943 INFO [Listener at localhost/41803] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36189 2023-07-11 21:58:26,730 WARN [Listener at localhost/33977] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:58:26,884 WARN [Listener at localhost/33977] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:58:26,892 WARN [Listener at localhost/33977] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:26,895 INFO [Listener at localhost/33977] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:26,923 INFO [Listener at localhost/33977] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_localhost_42373_datanode____.218y2w/webapp 2023-07-11 21:58:27,114 INFO [Listener at localhost/33977] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42373 2023-07-11 21:58:27,184 WARN [Listener at localhost/39549] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:58:27,293 WARN [Listener at localhost/39549] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:58:27,299 WARN [Listener at localhost/39549] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:27,302 INFO [Listener at localhost/39549] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:27,326 INFO [Listener at localhost/39549] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_localhost_38459_datanode____8httiy/webapp 2023-07-11 21:58:27,772 INFO [Listener at localhost/39549] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38459 2023-07-11 21:58:27,844 WARN [Listener at localhost/34469] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:58:28,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xebe61981791e03c4: Processing first storage report for DS-2285eb03-f392-4da0-80d6-233b38fe93f1 from datanode ce121982-e083-4225-b9b6-1f03f9aa8509 2023-07-11 21:58:28,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xebe61981791e03c4: from storage DS-2285eb03-f392-4da0-80d6-233b38fe93f1 node DatanodeRegistration(127.0.0.1:45665, datanodeUuid=ce121982-e083-4225-b9b6-1f03f9aa8509, infoPort=41767, infoSecurePort=0, ipcPort=39549, storageInfo=lv=-57;cid=testClusterID;nsid=331261700;c=1689112702928), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-11 21:58:28,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x46faa99d47c14cb1: Processing first storage report for DS-bdea6705-a691-4a62-a28f-14804f832183 from datanode 6fa56d19-15a7-4d6f-898b-55beed307cbc 2023-07-11 21:58:28,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x46faa99d47c14cb1: from storage DS-bdea6705-a691-4a62-a28f-14804f832183 node DatanodeRegistration(127.0.0.1:37137, datanodeUuid=6fa56d19-15a7-4d6f-898b-55beed307cbc, infoPort=46035, infoSecurePort=0, ipcPort=34469, storageInfo=lv=-57;cid=testClusterID;nsid=331261700;c=1689112702928), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:58:28,419 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x46faa99d47c14cb1: Processing first storage report for DS-f34ddcc3-51c4-43cf-b937-b2ca2a039358 from datanode 6fa56d19-15a7-4d6f-898b-55beed307cbc 2023-07-11 21:58:28,420 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x46faa99d47c14cb1: from storage DS-f34ddcc3-51c4-43cf-b937-b2ca2a039358 node DatanodeRegistration(127.0.0.1:37137, datanodeUuid=6fa56d19-15a7-4d6f-898b-55beed307cbc, infoPort=46035, infoSecurePort=0, ipcPort=34469, storageInfo=lv=-57;cid=testClusterID;nsid=331261700;c=1689112702928), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:58:28,420 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xebe61981791e03c4: Processing first storage report for DS-69e05393-4dbf-4152-ab55-f768d40f871e from datanode ce121982-e083-4225-b9b6-1f03f9aa8509 2023-07-11 21:58:28,420 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xebe61981791e03c4: from storage DS-69e05393-4dbf-4152-ab55-f768d40f871e node DatanodeRegistration(127.0.0.1:45665, datanodeUuid=ce121982-e083-4225-b9b6-1f03f9aa8509, infoPort=41767, infoSecurePort=0, ipcPort=39549, storageInfo=lv=-57;cid=testClusterID;nsid=331261700;c=1689112702928), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:58:28,420 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12c4c3eab06e77d9: Processing first storage report for DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5 from datanode 551e84d3-86c6-4f36-b07d-511a4c0763d2 2023-07-11 21:58:28,420 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12c4c3eab06e77d9: from storage DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5 node DatanodeRegistration(127.0.0.1:36571, datanodeUuid=551e84d3-86c6-4f36-b07d-511a4c0763d2, infoPort=39243, infoSecurePort=0, ipcPort=33977, storageInfo=lv=-57;cid=testClusterID;nsid=331261700;c=1689112702928), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:58:28,421 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12c4c3eab06e77d9: Processing first storage report for DS-9b152909-5a17-47c5-8f79-8be1ffdfab48 from datanode 551e84d3-86c6-4f36-b07d-511a4c0763d2 2023-07-11 21:58:28,421 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12c4c3eab06e77d9: from storage DS-9b152909-5a17-47c5-8f79-8be1ffdfab48 node DatanodeRegistration(127.0.0.1:36571, datanodeUuid=551e84d3-86c6-4f36-b07d-511a4c0763d2, infoPort=39243, infoSecurePort=0, ipcPort=33977, storageInfo=lv=-57;cid=testClusterID;nsid=331261700;c=1689112702928), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:58:28,881 DEBUG [Listener at localhost/34469] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068 2023-07-11 21:58:29,150 INFO [Listener at localhost/34469] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/zookeeper_0, clientPort=58667, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 21:58:29,209 INFO [Listener at localhost/34469] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58667 2023-07-11 21:58:29,234 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:29,241 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:30,165 INFO [Listener at localhost/34469] util.FSUtils(471): Created version file at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 with version=8 2023-07-11 21:58:30,166 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/hbase-staging 2023-07-11 21:58:30,694 INFO [Listener at localhost/34469] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 21:58:31,722 INFO [Listener at localhost/34469] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:58:31,774 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:31,775 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:31,775 INFO [Listener at localhost/34469] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:58:31,775 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:31,775 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:58:32,036 INFO [Listener at localhost/34469] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:58:32,150 DEBUG [Listener at localhost/34469] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 21:58:32,298 INFO [Listener at localhost/34469] ipc.NettyRpcServer(120): Bind to /172.31.10.131:33801 2023-07-11 21:58:32,317 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:32,320 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:32,354 INFO [Listener at localhost/34469] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33801 connecting to ZooKeeper ensemble=127.0.0.1:58667 2023-07-11 21:58:32,469 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:338010x0, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:58:32,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33801-0x101c201523b0000 connected 2023-07-11 21:58:32,624 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:58:32,626 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:58:32,660 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:58:32,675 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33801 2023-07-11 21:58:32,683 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33801 2023-07-11 21:58:32,696 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33801 2023-07-11 21:58:32,697 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33801 2023-07-11 21:58:32,698 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33801 2023-07-11 21:58:32,717 INFO [Listener at localhost/34469] master.HMaster(444): hbase.rootdir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, hbase.cluster.distributed=false 2023-07-11 21:58:32,889 INFO [Listener at localhost/34469] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:58:32,889 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:32,890 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:32,890 INFO [Listener at localhost/34469] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:58:32,891 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:32,891 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:58:32,899 INFO [Listener at localhost/34469] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:58:32,926 INFO [Listener at localhost/34469] ipc.NettyRpcServer(120): Bind to /172.31.10.131:37459 2023-07-11 21:58:32,931 INFO [Listener at localhost/34469] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:58:32,969 DEBUG [Listener at localhost/34469] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:58:32,971 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:32,974 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:32,977 INFO [Listener at localhost/34469] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37459 connecting to ZooKeeper ensemble=127.0.0.1:58667 2023-07-11 21:58:33,002 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:374590x0, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:58:33,003 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:374590x0, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:58:33,005 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:374590x0, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:58:33,024 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:374590x0, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:58:33,028 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37459 2023-07-11 21:58:33,031 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37459 2023-07-11 21:58:33,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37459-0x101c201523b0001 connected 2023-07-11 21:58:33,034 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37459 2023-07-11 21:58:33,071 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37459 2023-07-11 21:58:33,091 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37459 2023-07-11 21:58:33,127 INFO [Listener at localhost/34469] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:58:33,127 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:33,128 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:33,128 INFO [Listener at localhost/34469] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:58:33,129 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:33,129 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:58:33,129 INFO [Listener at localhost/34469] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:58:33,133 INFO [Listener at localhost/34469] ipc.NettyRpcServer(120): Bind to /172.31.10.131:34709 2023-07-11 21:58:33,134 INFO [Listener at localhost/34469] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:58:33,166 DEBUG [Listener at localhost/34469] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:58:33,168 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:33,177 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:33,198 INFO [Listener at localhost/34469] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34709 connecting to ZooKeeper ensemble=127.0.0.1:58667 2023-07-11 21:58:33,225 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:347090x0, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:58:33,227 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:347090x0, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:58:33,228 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:347090x0, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:58:33,233 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:347090x0, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:58:33,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34709-0x101c201523b0002 connected 2023-07-11 21:58:33,244 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34709 2023-07-11 21:58:33,244 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34709 2023-07-11 21:58:33,245 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34709 2023-07-11 21:58:33,252 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34709 2023-07-11 21:58:33,253 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34709 2023-07-11 21:58:33,270 INFO [Listener at localhost/34469] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:58:33,271 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:33,271 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:33,271 INFO [Listener at localhost/34469] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:58:33,271 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:58:33,271 INFO [Listener at localhost/34469] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:58:33,272 INFO [Listener at localhost/34469] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:58:33,281 INFO [Listener at localhost/34469] ipc.NettyRpcServer(120): Bind to /172.31.10.131:36649 2023-07-11 21:58:33,282 INFO [Listener at localhost/34469] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:58:33,286 DEBUG [Listener at localhost/34469] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:58:33,289 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:33,292 INFO [Listener at localhost/34469] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:33,293 INFO [Listener at localhost/34469] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36649 connecting to ZooKeeper ensemble=127.0.0.1:58667 2023-07-11 21:58:33,335 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:366490x0, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:58:33,348 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:58:33,350 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:58:33,351 DEBUG [Listener at localhost/34469] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:58:33,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36649-0x101c201523b0003 connected 2023-07-11 21:58:33,355 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36649 2023-07-11 21:58:33,356 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36649 2023-07-11 21:58:33,357 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36649 2023-07-11 21:58:33,374 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36649 2023-07-11 21:58:33,383 DEBUG [Listener at localhost/34469] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36649 2023-07-11 21:58:33,400 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:33,414 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:58:33,419 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:33,449 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:58:33,450 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:58:33,451 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:58:33,451 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:33,451 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:58:33,459 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:58:33,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:58:33,475 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,33801,1689112710414 from backup master directory 2023-07-11 21:58:33,480 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:33,480 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:58:33,487 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:58:33,488 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:33,492 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 21:58:33,515 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 21:58:33,738 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/hbase.id with ID: cc6f8f4e-fd43-47b6-aa92-498725f2c765 2023-07-11 21:58:33,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:58:33,832 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:33,918 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3f8fc9e5 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:34,026 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e84890b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:34,068 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:58:34,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 21:58:34,096 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 21:58:34,096 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 21:58:34,099 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:58:34,105 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:58:34,107 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:58:34,163 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store-tmp 2023-07-11 21:58:34,302 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:34,302 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:58:34,302 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:58:34,303 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:58:34,303 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:58:34,303 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:58:34,303 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:58:34,303 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:58:34,309 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/WALs/jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:34,340 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C33801%2C1689112710414, suffix=, logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/WALs/jenkins-hbase5.apache.org,33801,1689112710414, archiveDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/oldWALs, maxLogs=10 2023-07-11 21:58:34,469 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK] 2023-07-11 21:58:34,504 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK] 2023-07-11 21:58:34,469 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK] 2023-07-11 21:58:34,528 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:58:34,637 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/WALs/jenkins-hbase5.apache.org,33801,1689112710414/jenkins-hbase5.apache.org%2C33801%2C1689112710414.1689112714358 2023-07-11 21:58:34,639 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK], DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK]] 2023-07-11 21:58:34,640 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:58:34,641 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:34,647 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:58:34,650 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:58:34,752 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:58:34,771 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 21:58:34,838 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 21:58:34,855 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:34,872 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:58:34,875 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:58:34,912 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:58:34,918 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:58:34,919 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71990894, jitterRate=0.07274791598320007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:58:34,919 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:58:34,921 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 21:58:34,950 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 21:58:34,950 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 21:58:34,954 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 21:58:34,956 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 21:58:35,009 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-11 21:58:35,009 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 21:58:35,052 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 21:58:35,060 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 21:58:35,099 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 21:58:35,107 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 21:58:35,109 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 21:58:35,119 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 21:58:35,129 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 21:58:35,173 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:35,179 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 21:58:35,180 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 21:58:35,217 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 21:58:35,226 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:58:35,226 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:35,226 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:58:35,226 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:58:35,226 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:58:35,241 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,33801,1689112710414, sessionid=0x101c201523b0000, setting cluster-up flag (Was=false) 2023-07-11 21:58:35,277 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:35,286 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 21:58:35,288 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:35,294 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:35,313 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 21:58:35,315 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:35,325 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp 2023-07-11 21:58:35,427 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(951): ClusterId : cc6f8f4e-fd43-47b6-aa92-498725f2c765 2023-07-11 21:58:35,444 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(951): ClusterId : cc6f8f4e-fd43-47b6-aa92-498725f2c765 2023-07-11 21:58:35,431 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(951): ClusterId : cc6f8f4e-fd43-47b6-aa92-498725f2c765 2023-07-11 21:58:35,457 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:58:35,458 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:58:35,457 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:58:35,480 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:58:35,481 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:58:35,480 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:58:35,481 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:58:35,481 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:58:35,481 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:58:35,492 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:58:35,492 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:58:35,495 DEBUG [RS:1;jenkins-hbase5:34709] zookeeper.ReadOnlyZKClient(139): Connect 0x53233c4f to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:35,495 DEBUG [RS:0;jenkins-hbase5:37459] zookeeper.ReadOnlyZKClient(139): Connect 0x2d0886ac to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:35,506 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:58:35,519 DEBUG [RS:2;jenkins-hbase5:36649] zookeeper.ReadOnlyZKClient(139): Connect 0x365c2d0d to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:35,567 DEBUG [RS:0;jenkins-hbase5:37459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23cf7d7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:35,573 DEBUG [RS:0;jenkins-hbase5:37459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27f0eddc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:58:35,567 DEBUG [RS:1;jenkins-hbase5:34709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5de4c85b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:35,579 DEBUG [RS:1;jenkins-hbase5:34709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59db573f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:58:35,594 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-11 21:58:35,609 INFO [master/jenkins-hbase5:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:35,609 INFO [master/jenkins-hbase5:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-11 21:58:35,611 DEBUG [RS:2;jenkins-hbase5:36649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@389bd5b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:35,611 DEBUG [RS:2;jenkins-hbase5:36649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a6df8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:58:35,629 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:37459 2023-07-11 21:58:35,631 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase5:34709 2023-07-11 21:58:35,642 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase5:36649 2023-07-11 21:58:35,646 INFO [RS:1;jenkins-hbase5:34709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:58:35,646 INFO [RS:1;jenkins-hbase5:34709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:58:35,646 INFO [RS:0;jenkins-hbase5:37459] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:58:35,648 INFO [RS:0;jenkins-hbase5:37459] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:58:35,649 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 21:58:35,647 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 21:58:35,651 INFO [RS:0;jenkins-hbase5:37459] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:35,655 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:58:35,655 INFO [RS:1;jenkins-hbase5:34709] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:35,655 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:58:35,659 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33801,1689112710414 with isa=jenkins-hbase5.apache.org/172.31.10.131:37459, startcode=1689112712887 2023-07-11 21:58:35,647 INFO [RS:2;jenkins-hbase5:36649] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:58:35,659 INFO [RS:2;jenkins-hbase5:36649] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:58:35,659 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 21:58:35,660 INFO [RS:2;jenkins-hbase5:36649] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:35,660 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:58:35,666 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33801,1689112710414 with isa=jenkins-hbase5.apache.org/172.31.10.131:36649, startcode=1689112713270 2023-07-11 21:58:35,675 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33801,1689112710414 with isa=jenkins-hbase5.apache.org/172.31.10.131:34709, startcode=1689112713115 2023-07-11 21:58:35,697 DEBUG [RS:1;jenkins-hbase5:34709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:58:35,698 DEBUG [RS:2;jenkins-hbase5:36649] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:58:35,697 DEBUG [RS:0;jenkins-hbase5:37459] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:58:35,819 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 21:58:35,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:58:35,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:58:35,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:58:35,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:58:35,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-11 21:58:35,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:35,844 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:58:35,844 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:35,864 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689112745863 2023-07-11 21:58:35,867 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 21:58:35,886 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47167, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:58:35,889 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47567, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:58:35,891 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:58:35,892 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 21:58:35,895 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56799, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:58:35,895 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 21:58:35,901 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33801] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:58:35,902 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:58:35,906 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 21:58:35,908 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 21:58:35,908 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 21:58:35,909 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 21:58:35,920 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33801] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:58:35,942 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33801] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:58:35,969 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:35,980 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 21:58:35,991 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 21:58:35,996 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 21:58:36,015 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 21:58:36,016 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 21:58:36,022 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:58:36,022 WARN [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:58:36,027 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689112716018,5,FailOnTimeoutGroup] 2023-07-11 21:58:36,037 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:58:36,037 WARN [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:58:36,037 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:58:36,037 WARN [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:58:36,039 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689112716027,5,FailOnTimeoutGroup] 2023-07-11 21:58:36,044 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,045 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 21:58:36,046 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,047 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,097 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:58:36,099 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:58:36,099 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:58:36,130 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33801,1689112710414 with isa=jenkins-hbase5.apache.org/172.31.10.131:37459, startcode=1689112712887 2023-07-11 21:58:36,141 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33801,1689112710414 with isa=jenkins-hbase5.apache.org/172.31.10.131:36649, startcode=1689112713270 2023-07-11 21:58:36,148 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33801] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,152 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,33801,1689112710414 with isa=jenkins-hbase5.apache.org/172.31.10.131:34709, startcode=1689112713115 2023-07-11 21:58:36,155 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33801] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,156 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33801] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,169 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:58:36,179 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:58:36,179 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41803 2023-07-11 21:58:36,179 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:58:36,179 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41803 2023-07-11 21:58:36,179 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:58:36,179 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41803 2023-07-11 21:58:36,179 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:58:36,183 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:58:36,189 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:58:36,194 DEBUG [RS:2;jenkins-hbase5:36649] zookeeper.ZKUtil(162): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,196 DEBUG [RS:1;jenkins-hbase5:34709] zookeeper.ZKUtil(162): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,198 DEBUG [RS:0;jenkins-hbase5:37459] zookeeper.ZKUtil(162): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,203 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,37459,1689112712887] 2023-07-11 21:58:36,203 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,36649,1689112713270] 2023-07-11 21:58:36,203 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,34709,1689112713115] 2023-07-11 21:58:36,195 WARN [RS:2;jenkins-hbase5:36649] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:58:36,203 INFO [RS:2;jenkins-hbase5:36649] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:58:36,203 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,198 WARN [RS:0;jenkins-hbase5:37459] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:58:36,197 WARN [RS:1;jenkins-hbase5:34709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:58:36,205 INFO [RS:0;jenkins-hbase5:37459] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:58:36,212 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,205 INFO [RS:1;jenkins-hbase5:34709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:58:36,217 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,276 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:36,280 DEBUG [RS:2;jenkins-hbase5:36649] zookeeper.ZKUtil(162): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,281 DEBUG [RS:1;jenkins-hbase5:34709] zookeeper.ZKUtil(162): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,281 DEBUG [RS:2;jenkins-hbase5:36649] zookeeper.ZKUtil(162): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,281 DEBUG [RS:0;jenkins-hbase5:37459] zookeeper.ZKUtil(162): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,281 DEBUG [RS:1;jenkins-hbase5:34709] zookeeper.ZKUtil(162): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,282 DEBUG [RS:0;jenkins-hbase5:37459] zookeeper.ZKUtil(162): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,282 DEBUG [RS:1;jenkins-hbase5:34709] zookeeper.ZKUtil(162): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,282 DEBUG [RS:2;jenkins-hbase5:36649] zookeeper.ZKUtil(162): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,286 DEBUG [RS:0;jenkins-hbase5:37459] zookeeper.ZKUtil(162): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:58:36,306 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:58:36,306 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:58:36,306 DEBUG [RS:0;jenkins-hbase5:37459] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:58:36,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/info 2023-07-11 21:58:36,320 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:58:36,323 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:36,324 INFO [RS:0;jenkins-hbase5:37459] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:58:36,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:58:36,323 INFO [RS:1;jenkins-hbase5:34709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:58:36,323 INFO [RS:2;jenkins-hbase5:36649] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:58:36,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:58:36,333 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:58:36,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:36,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:58:36,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/table 2023-07-11 21:58:36,348 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:58:36,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:36,350 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740 2023-07-11 21:58:36,368 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740 2023-07-11 21:58:36,373 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 21:58:36,376 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:58:36,384 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:58:36,385 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64527775, jitterRate=-0.03846122324466705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 21:58:36,385 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:58:36,385 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:58:36,385 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:58:36,385 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:58:36,385 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:58:36,385 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:58:36,420 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:58:36,420 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:58:36,435 INFO [RS:2;jenkins-hbase5:36649] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:58:36,461 INFO [RS:0;jenkins-hbase5:37459] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:58:36,463 INFO [RS:1;jenkins-hbase5:34709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:58:36,465 INFO [RS:2;jenkins-hbase5:36649] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:58:36,466 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,469 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:58:36,469 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 21:58:36,469 INFO [RS:0;jenkins-hbase5:37459] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:58:36,470 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,491 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:58:36,496 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:58:36,506 INFO [RS:1;jenkins-hbase5:34709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:58:36,506 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,512 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:58:36,516 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,516 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,516 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,516 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,516 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,516 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,528 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:58:36,528 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,528 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,528 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,528 DEBUG [RS:1;jenkins-hbase5:34709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,529 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,529 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 21:58:36,542 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,542 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,542 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,530 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,552 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,552 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,553 DEBUG [RS:0;jenkins-hbase5:37459] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,530 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,554 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,554 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,554 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,554 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,554 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:58:36,554 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,555 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,555 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,555 DEBUG [RS:2;jenkins-hbase5:36649] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:58:36,573 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,574 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,574 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,596 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,596 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,596 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,599 INFO [RS:1;jenkins-hbase5:34709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:58:36,603 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,34709,1689112713115-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,629 INFO [RS:0;jenkins-hbase5:37459] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:58:36,636 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,37459,1689112712887-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,635 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 21:58:36,639 INFO [RS:2;jenkins-hbase5:36649] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:58:36,639 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36649,1689112713270-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:36,645 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 21:58:36,681 INFO [RS:2;jenkins-hbase5:36649] regionserver.Replication(203): jenkins-hbase5.apache.org,36649,1689112713270 started 2023-07-11 21:58:36,682 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,36649,1689112713270, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:36649, sessionid=0x101c201523b0003 2023-07-11 21:58:36,689 INFO [RS:0;jenkins-hbase5:37459] regionserver.Replication(203): jenkins-hbase5.apache.org,37459,1689112712887 started 2023-07-11 21:58:36,689 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,37459,1689112712887, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:37459, sessionid=0x101c201523b0001 2023-07-11 21:58:36,689 INFO [RS:1;jenkins-hbase5:34709] regionserver.Replication(203): jenkins-hbase5.apache.org,34709,1689112713115 started 2023-07-11 21:58:36,689 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:58:36,689 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,34709,1689112713115, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:34709, sessionid=0x101c201523b0002 2023-07-11 21:58:36,690 DEBUG [RS:0;jenkins-hbase5:37459] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,690 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:58:36,689 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:58:36,690 DEBUG [RS:1;jenkins-hbase5:34709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,690 DEBUG [RS:0;jenkins-hbase5:37459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,37459,1689112712887' 2023-07-11 21:58:36,691 DEBUG [RS:1;jenkins-hbase5:34709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,34709,1689112713115' 2023-07-11 21:58:36,691 DEBUG [RS:2;jenkins-hbase5:36649] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,692 DEBUG [RS:1;jenkins-hbase5:34709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:58:36,693 DEBUG [RS:1;jenkins-hbase5:34709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:58:36,694 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:58:36,694 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:58:36,694 DEBUG [RS:1;jenkins-hbase5:34709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:36,694 DEBUG [RS:1;jenkins-hbase5:34709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,34709,1689112713115' 2023-07-11 21:58:36,694 DEBUG [RS:1;jenkins-hbase5:34709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:36,695 DEBUG [RS:1;jenkins-hbase5:34709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:36,696 DEBUG [RS:1;jenkins-hbase5:34709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:58:36,696 INFO [RS:1;jenkins-hbase5:34709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:58:36,697 INFO [RS:1;jenkins-hbase5:34709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:58:36,692 DEBUG [RS:0;jenkins-hbase5:37459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:58:36,692 DEBUG [RS:2;jenkins-hbase5:36649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,36649,1689112713270' 2023-07-11 21:58:36,697 DEBUG [RS:2;jenkins-hbase5:36649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:58:36,697 DEBUG [RS:0;jenkins-hbase5:37459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:58:36,697 DEBUG [RS:2;jenkins-hbase5:36649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:58:36,698 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:58:36,698 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:58:36,698 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:58:36,698 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:58:36,698 DEBUG [RS:0;jenkins-hbase5:37459] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:36,699 DEBUG [RS:2;jenkins-hbase5:36649] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:36,699 DEBUG [RS:2;jenkins-hbase5:36649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,36649,1689112713270' 2023-07-11 21:58:36,699 DEBUG [RS:2;jenkins-hbase5:36649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:36,699 DEBUG [RS:0;jenkins-hbase5:37459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,37459,1689112712887' 2023-07-11 21:58:36,699 DEBUG [RS:0;jenkins-hbase5:37459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:36,700 DEBUG [RS:2;jenkins-hbase5:36649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:36,700 DEBUG [RS:0;jenkins-hbase5:37459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:36,701 DEBUG [RS:0;jenkins-hbase5:37459] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:58:36,701 DEBUG [RS:2;jenkins-hbase5:36649] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:58:36,701 INFO [RS:0;jenkins-hbase5:37459] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:58:36,701 INFO [RS:2;jenkins-hbase5:36649] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:58:36,704 INFO [RS:0;jenkins-hbase5:37459] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:58:36,704 INFO [RS:2;jenkins-hbase5:36649] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:58:36,797 DEBUG [jenkins-hbase5:33801] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 21:58:36,803 DEBUG [jenkins-hbase5:33801] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:58:36,812 INFO [RS:2;jenkins-hbase5:36649] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C36649%2C1689112713270, suffix=, logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,36649,1689112713270, archiveDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs, maxLogs=32 2023-07-11 21:58:36,812 INFO [RS:0;jenkins-hbase5:37459] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C37459%2C1689112712887, suffix=, logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,37459,1689112712887, archiveDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs, maxLogs=32 2023-07-11 21:58:36,815 INFO [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C34709%2C1689112713115, suffix=, logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,34709,1689112713115, archiveDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs, maxLogs=32 2023-07-11 21:58:36,823 DEBUG [jenkins-hbase5:33801] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:58:36,823 DEBUG [jenkins-hbase5:33801] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:58:36,824 DEBUG [jenkins-hbase5:33801] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:58:36,825 DEBUG [jenkins-hbase5:33801] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:58:36,837 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,34709,1689112713115, state=OPENING 2023-07-11 21:58:36,847 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 21:58:36,850 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:36,851 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:58:36,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:58:36,922 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK] 2023-07-11 21:58:36,938 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK] 2023-07-11 21:58:36,951 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK] 2023-07-11 21:58:36,968 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK] 2023-07-11 21:58:36,974 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK] 2023-07-11 21:58:36,984 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK] 2023-07-11 21:58:36,988 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK] 2023-07-11 21:58:36,989 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK] 2023-07-11 21:58:36,989 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK] 2023-07-11 21:58:36,997 INFO [RS:2;jenkins-hbase5:36649] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,36649,1689112713270/jenkins-hbase5.apache.org%2C36649%2C1689112713270.1689112716824 2023-07-11 21:58:37,004 DEBUG [RS:2;jenkins-hbase5:36649] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK], DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK]] 2023-07-11 21:58:37,009 INFO [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,34709,1689112713115/jenkins-hbase5.apache.org%2C34709%2C1689112713115.1689112716821 2023-07-11 21:58:37,016 DEBUG [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK], DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK], DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK]] 2023-07-11 21:58:37,018 INFO [RS:0;jenkins-hbase5:37459] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,37459,1689112712887/jenkins-hbase5.apache.org%2C37459%2C1689112712887.1689112716823 2023-07-11 21:58:37,019 DEBUG [RS:0;jenkins-hbase5:37459] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK], DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK], DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK]] 2023-07-11 21:58:37,186 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:37,190 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:58:37,198 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:58:37,225 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 21:58:37,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:58:37,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C34709%2C1689112713115.meta, suffix=.meta, logDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,34709,1689112713115, archiveDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs, maxLogs=32 2023-07-11 21:58:37,277 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK] 2023-07-11 21:58:37,278 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK] 2023-07-11 21:58:37,279 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK] 2023-07-11 21:58:37,307 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/WALs/jenkins-hbase5.apache.org,34709,1689112713115/jenkins-hbase5.apache.org%2C34709%2C1689112713115.meta.1689112717232.meta 2023-07-11 21:58:37,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36571,DS-7e9c1676-9dda-4c95-bd01-04feeefff8f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37137,DS-bdea6705-a691-4a62-a28f-14804f832183,DISK], DatanodeInfoWithStorage[127.0.0.1:45665,DS-2285eb03-f392-4da0-80d6-233b38fe93f1,DISK]] 2023-07-11 21:58:37,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:58:37,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-11 21:58:37,315 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:37,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 21:58:37,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 21:58:37,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 21:58:37,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 21:58:37,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:37,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 21:58:37,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 21:58:37,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:58:37,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/info 2023-07-11 21:58:37,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/info 2023-07-11 21:58:37,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:58:37,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:37,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:58:37,356 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:58:37,356 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:58:37,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:58:37,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:37,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:58:37,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/table 2023-07-11 21:58:37,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/table 2023-07-11 21:58:37,369 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:58:37,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:37,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740 2023-07-11 21:58:37,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740 2023-07-11 21:58:37,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 21:58:37,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:58:37,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69427997, jitterRate=0.0345577746629715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 21:58:37,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:58:37,419 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689112717175 2023-07-11 21:58:37,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 21:58:37,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 21:58:37,464 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,34709,1689112713115, state=OPEN 2023-07-11 21:58:37,468 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 21:58:37,468 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:58:37,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 21:58:37,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,34709,1689112713115 in 606 msec 2023-07-11 21:58:37,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 21:58:37,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 941 msec 2023-07-11 21:58:37,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.8720 sec 2023-07-11 21:58:37,505 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689112717504, completionTime=-1 2023-07-11 21:58:37,505 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 21:58:37,505 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 21:58:37,616 DEBUG [hconnection-0x7aadf1de-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:37,634 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:37,662 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 21:58:37,662 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689112777662 2023-07-11 21:58:37,662 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689112837662 2023-07-11 21:58:37,663 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 157 msec 2023-07-11 21:58:37,704 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33801,1689112710414-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:37,704 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33801,1689112710414-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:37,707 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33801,1689112710414-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:37,710 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:33801, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:37,711 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 21:58:37,732 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 21:58:37,736 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 21:58:37,738 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:58:37,753 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 21:58:37,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:58:37,761 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:58:37,795 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:37,799 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261 empty. 2023-07-11 21:58:37,800 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:37,801 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 21:58:37,886 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 21:58:37,889 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => fe36995c45b29e8fb799e440fc044261, NAME => 'hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:58:37,958 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:37,958 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing fe36995c45b29e8fb799e440fc044261, disabling compactions & flushes 2023-07-11 21:58:37,958 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:37,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:37,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. after waiting 0 ms 2023-07-11 21:58:37,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:37,959 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:37,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for fe36995c45b29e8fb799e440fc044261: 2023-07-11 21:58:37,984 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:58:38,006 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689112717988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112717988"}]},"ts":"1689112717988"} 2023-07-11 21:58:38,037 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:58:38,043 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:58:38,050 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112718044"}]},"ts":"1689112718044"} 2023-07-11 21:58:38,054 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 21:58:38,066 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:58:38,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:58:38,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:58:38,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:58:38,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:58:38,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fe36995c45b29e8fb799e440fc044261, ASSIGN}] 2023-07-11 21:58:38,078 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fe36995c45b29e8fb799e440fc044261, ASSIGN 2023-07-11 21:58:38,081 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fe36995c45b29e8fb799e440fc044261, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36649,1689112713270; forceNewPlan=false, retain=false 2023-07-11 21:58:38,233 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 21:58:38,235 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fe36995c45b29e8fb799e440fc044261, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:38,235 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689112718235"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112718235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112718235"}]},"ts":"1689112718235"} 2023-07-11 21:58:38,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fe36995c45b29e8fb799e440fc044261, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 21:58:38,409 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:38,410 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:58:38,414 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:52046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:58:38,444 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:38,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe36995c45b29e8fb799e440fc044261, NAME => 'hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:58:38,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. service=AccessControlService 2023-07-11 21:58:38,446 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:38,446 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,447 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:38,447 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,447 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,451 INFO [StoreOpener-fe36995c45b29e8fb799e440fc044261-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,460 DEBUG [StoreOpener-fe36995c45b29e8fb799e440fc044261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/info 2023-07-11 21:58:38,460 DEBUG [StoreOpener-fe36995c45b29e8fb799e440fc044261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/info 2023-07-11 21:58:38,461 INFO [StoreOpener-fe36995c45b29e8fb799e440fc044261-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe36995c45b29e8fb799e440fc044261 columnFamilyName info 2023-07-11 21:58:38,463 INFO [StoreOpener-fe36995c45b29e8fb799e440fc044261-1] regionserver.HStore(310): Store=fe36995c45b29e8fb799e440fc044261/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:38,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,474 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fe36995c45b29e8fb799e440fc044261 2023-07-11 21:58:38,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:58:38,496 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fe36995c45b29e8fb799e440fc044261; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62801982, jitterRate=-0.06417754292488098}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:58:38,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fe36995c45b29e8fb799e440fc044261: 2023-07-11 21:58:38,500 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261., pid=6, masterSystemTime=1689112718409 2023-07-11 21:58:38,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:38,512 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 21:58:38,515 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fe36995c45b29e8fb799e440fc044261, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:38,515 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689112718514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112718514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112718514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112718514"}]},"ts":"1689112718514"} 2023-07-11 21:58:38,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 21:58:38,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fe36995c45b29e8fb799e440fc044261, server=jenkins-hbase5.apache.org,36649,1689112713270 in 274 msec 2023-07-11 21:58:38,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 21:58:38,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fe36995c45b29e8fb799e440fc044261, ASSIGN in 461 msec 2023-07-11 21:58:38,540 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:58:38,540 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112718540"}]},"ts":"1689112718540"} 2023-07-11 21:58:38,545 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 21:58:38,550 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:58:38,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 811 msec 2023-07-11 21:58:38,564 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 21:58:38,579 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:58:38,579 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:38,620 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:38,623 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:52048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:38,639 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 21:58:38,670 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:58:38,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 70 msec 2023-07-11 21:58:38,704 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 21:58:38,731 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:58:38,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 55 msec 2023-07-11 21:58:38,778 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 21:58:38,799 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 21:58:38,799 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.311sec 2023-07-11 21:58:38,803 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 21:58:38,806 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 21:58:38,806 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 21:58:38,808 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33801,1689112710414-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 21:58:38,809 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,33801,1689112710414-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 21:58:38,835 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:58:38,842 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-11 21:58:38,845 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:58:38,849 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:58:38,851 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-11 21:58:38,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:38,857 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602 empty. 2023-07-11 21:58:38,860 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:38,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-11 21:58:38,864 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:58:38,877 DEBUG [Listener at localhost/34469] zookeeper.ReadOnlyZKClient(139): Connect 0x776a4d8e to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:38,921 DEBUG [Listener at localhost/34469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5057d4c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:38,923 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-11 21:58:38,927 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a1ee2f2e57ba767fb0915cd9b774e602, NAME => 'hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:58:38,974 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:58:39,024 DEBUG [hconnection-0xe8fab10-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:39,104 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:39,105 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a1ee2f2e57ba767fb0915cd9b774e602, disabling compactions & flushes 2023-07-11 21:58:39,105 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,105 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,105 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. after waiting 0 ms 2023-07-11 21:58:39,105 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,105 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,105 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a1ee2f2e57ba767fb0915cd9b774e602: 2023-07-11 21:58:39,109 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:39,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:58:39,115 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689112719115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112719115"}]},"ts":"1689112719115"} 2023-07-11 21:58:39,119 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:58:39,119 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/test.cache.data in system properties and HBase conf 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:58:39,120 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:58:39,121 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:58:39,122 INFO [Listener at localhost/34469] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-11 21:58:39,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:58:39,124 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112719124"}]},"ts":"1689112719124"} 2023-07-11 21:58:39,127 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-11 21:58:39,156 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:58:39,157 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:58:39,158 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:58:39,158 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:58:39,158 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:58:39,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a1ee2f2e57ba767fb0915cd9b774e602, ASSIGN}] 2023-07-11 21:58:39,162 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a1ee2f2e57ba767fb0915cd9b774e602, ASSIGN 2023-07-11 21:58:39,164 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a1ee2f2e57ba767fb0915cd9b774e602, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,34709,1689112713115; forceNewPlan=false, retain=false 2023-07-11 21:58:39,174 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:58:39,315 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 21:58:39,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a1ee2f2e57ba767fb0915cd9b774e602, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:39,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689112719316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112719316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112719316"}]},"ts":"1689112719316"} 2023-07-11 21:58:39,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a1ee2f2e57ba767fb0915cd9b774e602, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:58:39,475 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:58:39,546 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1ee2f2e57ba767fb0915cd9b774e602, NAME => 'hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:58:39,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. service=AccessControlService 2023-07-11 21:58:39,547 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:39,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:39,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,568 INFO [StoreOpener-a1ee2f2e57ba767fb0915cd9b774e602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,572 DEBUG [StoreOpener-a1ee2f2e57ba767fb0915cd9b774e602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/l 2023-07-11 21:58:39,572 DEBUG [StoreOpener-a1ee2f2e57ba767fb0915cd9b774e602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/l 2023-07-11 21:58:39,572 INFO [StoreOpener-a1ee2f2e57ba767fb0915cd9b774e602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1ee2f2e57ba767fb0915cd9b774e602 columnFamilyName l 2023-07-11 21:58:39,573 INFO [StoreOpener-a1ee2f2e57ba767fb0915cd9b774e602-1] regionserver.HStore(310): Store=a1ee2f2e57ba767fb0915cd9b774e602/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:39,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,578 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 21:58:39,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:58:39,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened a1ee2f2e57ba767fb0915cd9b774e602; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69493986, jitterRate=0.03554108738899231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:58:39,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for a1ee2f2e57ba767fb0915cd9b774e602: 2023-07-11 21:58:39,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602., pid=11, masterSystemTime=1689112719500 2023-07-11 21:58:39,618 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 21:58:39,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a1ee2f2e57ba767fb0915cd9b774e602, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:39,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689112719620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112719620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112719620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112719620"}]},"ts":"1689112719620"} 2023-07-11 21:58:39,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 21:58:39,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a1ee2f2e57ba767fb0915cd9b774e602, server=jenkins-hbase5.apache.org,34709,1689112713115 in 306 msec 2023-07-11 21:58:39,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 21:58:39,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a1ee2f2e57ba767fb0915cd9b774e602, ASSIGN in 476 msec 2023-07-11 21:58:39,644 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:58:39,645 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112719645"}]},"ts":"1689112719645"} 2023-07-11 21:58:39,648 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-11 21:58:39,652 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:58:39,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 816 msec 2023-07-11 21:58:39,975 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:58:39,975 INFO [master/jenkins-hbase5:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-11 21:58:40,018 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 21:58:40,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:58:40,685 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-11 21:58:40,685 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:58:40,685 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-11 21:58:40,685 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 21:58:40,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-11 21:58:40,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:58:40,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-11 21:58:40,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:58:40,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 21:58:42,318 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 21:58:42,329 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-11 21:58:42,330 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 21:58:43,173 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-nodemanager.properties,hadoop-metrics2.properties 2023-07-11 21:58:44,507 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:46,334 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:46,358 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_45949_jobhistory____.pe0rbv/webapp 2023-07-11 21:58:46,999 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-11 21:58:46,999 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-11 21:58:46,999 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:58:47,004 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:58:47,217 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:47,914 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:49,103 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-11 21:58:49,244 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:45949 2023-07-11 21:58:50,543 WARN [Listener at jenkins-hbase5.apache.org/34659] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:50,724 WARN [Listener at jenkins-hbase5.apache.org/34659] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 21:58:50,725 INFO [Listener at jenkins-hbase5.apache.org/34659] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:50,785 INFO [Listener at jenkins-hbase5.apache.org/34659] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_37765_cluster____d9y3kj/webapp 2023-07-11 21:58:50,938 INFO [Listener at jenkins-hbase5.apache.org/34659] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 21:58:50,939 INFO [Listener at jenkins-hbase5.apache.org/34659] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-11 21:58:50,939 INFO [Listener at jenkins-hbase5.apache.org/34659] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:58:50,940 INFO [Listener at jenkins-hbase5.apache.org/34659] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:58:50,963 INFO [Listener at jenkins-hbase5.apache.org/34659] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:51,485 INFO [Listener at jenkins-hbase5.apache.org/34659] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:51,883 INFO [Listener at jenkins-hbase5.apache.org/34659] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:51,930 INFO [Listener at jenkins-hbase5.apache.org/34659] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:37765 2023-07-11 21:58:52,896 WARN [Listener at jenkins-hbase5.apache.org/32995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:52,928 WARN [Listener at jenkins-hbase5.apache.org/32995] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 21:58:52,928 INFO [Listener at jenkins-hbase5.apache.org/32995] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:52,945 INFO [Listener at jenkins-hbase5.apache.org/32995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_37783_node____rkph4b/webapp 2023-07-11 21:58:53,055 INFO [Listener at jenkins-hbase5.apache.org/32995] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 21:58:53,056 INFO [Listener at jenkins-hbase5.apache.org/32995] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:58:53,056 INFO [Listener at jenkins-hbase5.apache.org/32995] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 21:58:53,056 INFO [Listener at jenkins-hbase5.apache.org/32995] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:58:53,068 INFO [Listener at jenkins-hbase5.apache.org/32995] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:53,102 INFO [Listener at jenkins-hbase5.apache.org/32995] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:53,239 INFO [Listener at jenkins-hbase5.apache.org/32995] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:53,288 INFO [Listener at jenkins-hbase5.apache.org/32995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:37783 2023-07-11 21:58:54,147 WARN [Listener at jenkins-hbase5.apache.org/41391] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:58:54,156 WARN [Listener at jenkins-hbase5.apache.org/41391] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 21:58:54,157 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:58:54,172 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_36485_node____.g7wlo5/webapp 2023-07-11 21:58:54,328 INFO [Listener at jenkins-hbase5.apache.org/41391] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 21:58:54,329 INFO [Listener at jenkins-hbase5.apache.org/41391] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 21:58:54,330 INFO [Listener at jenkins-hbase5.apache.org/41391] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 21:58:54,330 INFO [Listener at jenkins-hbase5.apache.org/41391] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 21:58:54,349 INFO [Listener at jenkins-hbase5.apache.org/41391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:54,393 INFO [Listener at jenkins-hbase5.apache.org/41391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:54,538 INFO [Listener at jenkins-hbase5.apache.org/41391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 21:58:54,547 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:36485 2023-07-11 21:58:54,578 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-11 21:58:54,580 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:58:54,664 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=867, MaxFileDescriptor=60000, SystemLoadAverage=914, ProcessCount=177, AvailableMemoryMB=2318 2023-07-11 21:58:54,664 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-07-11 21:58:54,683 DEBUG [Listener at jenkins-hbase5.apache.org/41391] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 21:58:54,709 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:41008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 21:58:54,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:58:54,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:58:54,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:58:54,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-11 21:58:54,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:58:54,733 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:58:54,755 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:54,773 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:54,773 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 empty. 2023-07-11 21:58:54,774 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f empty. 2023-07-11 21:58:54,774 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:54,777 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:54,777 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 21:58:54,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:58:54,926 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-11 21:58:54,945 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ebe23c75dcc48b0f0aa092a68f04d0c2, NAME => 'testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:58:54,969 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => ea3586c816343e98966f19e18ed02f1f, NAME => 'testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:58:55,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:58:55,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:55,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing ea3586c816343e98966f19e18ed02f1f, disabling compactions & flushes 2023-07-11 21:58:55,086 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. after waiting 0 ms 2023-07-11 21:58:55,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,086 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for ea3586c816343e98966f19e18ed02f1f: 2023-07-11 21:58:55,087 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:55,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ebe23c75dcc48b0f0aa092a68f04d0c2, disabling compactions & flushes 2023-07-11 21:58:55,088 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. after waiting 0 ms 2023-07-11 21:58:55,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,088 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ebe23c75dcc48b0f0aa092a68f04d0c2: 2023-07-11 21:58:55,092 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:58:55,094 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112735094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112735094"}]},"ts":"1689112735094"} 2023-07-11 21:58:55,094 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112735094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112735094"}]},"ts":"1689112735094"} 2023-07-11 21:58:55,158 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:58:55,161 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:58:55,161 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112735161"}]},"ts":"1689112735161"} 2023-07-11 21:58:55,164 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-11 21:58:55,169 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:58:55,171 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:58:55,171 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:58:55,171 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:58:55,171 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:58:55,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, ASSIGN}] 2023-07-11 21:58:55,175 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, ASSIGN 2023-07-11 21:58:55,175 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, ASSIGN 2023-07-11 21:58:55,176 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,34709,1689112713115; forceNewPlan=false, retain=false 2023-07-11 21:58:55,176 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36649,1689112713270; forceNewPlan=false, retain=false 2023-07-11 21:58:55,327 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:58:55,330 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ebe23c75dcc48b0f0aa092a68f04d0c2, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:55,331 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112735330"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112735330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112735330"}]},"ts":"1689112735330"} 2023-07-11 21:58:55,331 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ea3586c816343e98966f19e18ed02f1f, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:55,331 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112735331"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112735331"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112735331"}]},"ts":"1689112735331"} 2023-07-11 21:58:55,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure ebe23c75dcc48b0f0aa092a68f04d0c2, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 21:58:55,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure ea3586c816343e98966f19e18ed02f1f, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:58:55,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:58:55,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ebe23c75dcc48b0f0aa092a68f04d0c2, NAME => 'testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:58:55,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. service=AccessControlService 2023-07-11 21:58:55,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:55,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:55,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea3586c816343e98966f19e18ed02f1f, NAME => 'testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:58:55,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. service=AccessControlService 2023-07-11 21:58:55,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:58:55,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:58:55,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,535 INFO [StoreOpener-ea3586c816343e98966f19e18ed02f1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,538 INFO [StoreOpener-ebe23c75dcc48b0f0aa092a68f04d0c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,542 DEBUG [StoreOpener-ebe23c75dcc48b0f0aa092a68f04d0c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf 2023-07-11 21:58:55,542 DEBUG [StoreOpener-ea3586c816343e98966f19e18ed02f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf 2023-07-11 21:58:55,542 DEBUG [StoreOpener-ebe23c75dcc48b0f0aa092a68f04d0c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf 2023-07-11 21:58:55,542 DEBUG [StoreOpener-ea3586c816343e98966f19e18ed02f1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf 2023-07-11 21:58:55,543 INFO [StoreOpener-ea3586c816343e98966f19e18ed02f1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea3586c816343e98966f19e18ed02f1f columnFamilyName cf 2023-07-11 21:58:55,543 INFO [StoreOpener-ebe23c75dcc48b0f0aa092a68f04d0c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebe23c75dcc48b0f0aa092a68f04d0c2 columnFamilyName cf 2023-07-11 21:58:55,544 INFO [StoreOpener-ea3586c816343e98966f19e18ed02f1f-1] regionserver.HStore(310): Store=ea3586c816343e98966f19e18ed02f1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:55,546 INFO [StoreOpener-ebe23c75dcc48b0f0aa092a68f04d0c2-1] regionserver.HStore(310): Store=ebe23c75dcc48b0f0aa092a68f04d0c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:58:55,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:58:55,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:58:55,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:58:55,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ea3586c816343e98966f19e18ed02f1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68090826, jitterRate=0.014632374048233032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:58:55,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ea3586c816343e98966f19e18ed02f1f: 2023-07-11 21:58:55,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:58:55,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f., pid=16, masterSystemTime=1689112735494 2023-07-11 21:58:55,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ebe23c75dcc48b0f0aa092a68f04d0c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62662730, jitterRate=-0.06625255942344666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:58:55,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ebe23c75dcc48b0f0aa092a68f04d0c2: 2023-07-11 21:58:55,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:55,612 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ea3586c816343e98966f19e18ed02f1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:55,612 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112735612"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112735612"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112735612"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112735612"}]},"ts":"1689112735612"} 2023-07-11 21:58:55,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2., pid=15, masterSystemTime=1689112735491 2023-07-11 21:58:55,625 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ebe23c75dcc48b0f0aa092a68f04d0c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:55,635 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112735625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112735625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112735625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112735625"}]},"ts":"1689112735625"} 2023-07-11 21:58:55,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:55,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-11 21:58:55,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure ea3586c816343e98966f19e18ed02f1f, server=jenkins-hbase5.apache.org,34709,1689112713115 in 287 msec 2023-07-11 21:58:55,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-11 21:58:55,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure ebe23c75dcc48b0f0aa092a68f04d0c2, server=jenkins-hbase5.apache.org,36649,1689112713270 in 336 msec 2023-07-11 21:58:55,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, ASSIGN in 501 msec 2023-07-11 21:58:55,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 21:58:55,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, ASSIGN in 509 msec 2023-07-11 21:58:55,693 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:58:55,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112735693"}]},"ts":"1689112735693"} 2023-07-11 21:58:55,696 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-11 21:58:55,701 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:58:55,709 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-11 21:58:55,747 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 21:58:55,806 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:58:55,806 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:58:55,806 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:58:55,806 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:58:55,807 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 21:58:55,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:58:55,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:58:55,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:58:55,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:58:55,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:58:55,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:58:55,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:58:55,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 21:58:55,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1400 sec 2023-07-11 21:58:56,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 21:58:56,864 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-11 21:58:56,864 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-11 21:58:56,866 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:58:56,872 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-11 21:58:56,872 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:58:56,873 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-11 21:58:56,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:58:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112736897 (current time:1689112736897). 2023-07-11 21:58:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:58:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x60fdead9 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:56,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@511ba7a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:56,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:56,940 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:56,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60fdead9 to 127.0.0.1:58667 2023-07-11 21:58:56,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:58:56,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x4a1fabfe to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:56,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35079821, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:56,965 DEBUG [hconnection-0x70c58b53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:56,973 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:56,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a1fabfe to 127.0.0.1:58667 2023-07-11 21:58:56,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:58:56,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 21:58:57,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:58:57,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:58:57,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:58:57,034 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:58:57,035 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689113337035 2023-07-11 21:58:57,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:58:57,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 21:58:57,044 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:58:57,044 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:58:57,055 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:58:57,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:58:57,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 32 msec 2023-07-11 21:58:57,072 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:58:57,075 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689113337075 2023-07-11 21:58:57,144 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:57,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:57,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:58:57,152 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:58:57,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,162 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-11 21:58:57,162 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:57,165 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 21:58:57,165 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 21:58:57,166 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,166 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,177 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:57,177 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:57,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:57,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:57,177 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,177 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:57,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:57,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,179 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,179 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,180 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,180 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:58:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 21:58:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:58:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 21:58:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:58:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 21:58:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,183 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:58:57,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,187 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:58:57,187 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:57,188 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:58:57,188 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:57,188 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:58:57,189 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:58:57,189 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 21:58:57,197 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:58:57,198 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:57,197 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:58:57,198 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:58:57,198 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:58:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:58:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 21:58:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,203 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:58:57,198 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 21:58:57,203 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:57,206 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,206 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:58:57,206 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,206 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:57,207 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,207 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:58:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:57,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:58:57,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de06ec3[Count = 1] remaining members to acquire global barrier 2023-07-11 21:58:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:57,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:58:57,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de06ec3[Count = 0] remaining members to acquire global barrier 2023-07-11 21:58:57,215 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 21:58:57,215 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:58:57,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,219 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,223 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:58:57,224 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 21:58:57,224 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 21:58:57,224 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:58:57,225 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:58:57,225 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:58:57,225 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:57,226 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,226 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:58:57,226 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. started... 2023-07-11 21:58:57,229 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:58:57,229 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:58:57,230 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:58:57,230 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:57,230 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 21:58:57,232 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:57,232 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. started... 2023-07-11 21:58:57,234 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea3586c816343e98966f19e18ed02f1f: 2023-07-11 21:58:57,234 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebe23c75dcc48b0f0aa092a68f04d0c2: 2023-07-11 21:58:57,236 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,236 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,243 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:58:57,243 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:58:57,248 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:58:57,248 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:58:57,296 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. completed. 2023-07-11 21:58:57,296 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:57,297 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:58:57,297 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:58:57,297 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,297 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 21:58:57,297 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 21:58:57,299 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. completed. 2023-07-11 21:58:57,299 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:57,299 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:58:57,299 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:58:57,299 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,299 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 21:58:57,299 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 21:58:57,300 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:58:57,300 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:57,300 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,300 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 21:58:57,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:57,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:57,303 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,303 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:58:57,303 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:57,303 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 21:58:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,36649,1689112713270': 2023-07-11 21:58:57,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 21:58:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 21:58:57,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 21:58:57,316 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-11 21:58:57,317 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:58:57,317 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:58:57,317 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,317 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:58:57,321 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:57,322 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:57,322 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:57,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:57,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:57,331 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:57,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:57,331 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,334 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,338 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:57,339 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,340 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,353 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:57,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:57,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:58:57,358 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:58:57,359 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:57,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:57,359 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:57,359 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:57,359 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:57,359 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:57,359 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:57,360 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:57,361 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:57,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:57,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:57,364 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:57,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,364 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,364 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,364 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:57,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:57,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,659 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:57,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:58:57,661 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:58:57,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 21:58:57,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,693 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 21:58:57,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689112737037Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689112737364 (+327 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689112737364Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689112737405 (+41 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689112737506 (+101 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689112737691 (+185 ms) 2023-07-11 21:58:57,697 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:58:57,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 642 msec 2023-07-11 21:58:58,162 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:58,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:58,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:58:58,214 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:58,218 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:58,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36649] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:58:58,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34709] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:58:58,227 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 21:58:58,229 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:58,232 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:58:58,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:58:58,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112738338 (current time:1689112738338). 2023-07-11 21:58:58,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:58:58,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x41e03024 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:58,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@146366c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:58,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:58,377 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:58,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41e03024 to 127.0.0.1:58667 2023-07-11 21:58:58,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:58:58,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x420863c5 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:58:58,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a91ab0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:58:58,437 DEBUG [hconnection-0xd731967-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:58:58,443 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:58:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x420863c5 to 127.0.0.1:58667 2023-07-11 21:58:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:58:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 21:58:58,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:58:58,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:58:58,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:58:58,463 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:58:58,465 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689113338464 2023-07-11 21:58:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 21:58:58,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 21:58:58,472 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:58:58,472 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:58:58,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:58:58,478 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 21:58:58,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 20 msec 2023-07-11 21:58:58,483 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:58:58,485 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689113338485 2023-07-11 21:58:58,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-11 21:58:58,565 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-11 21:58:58,565 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:58,566 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 21:58:58,566 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 21:58:58,567 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,567 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,570 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:58,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:58,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:58,570 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,570 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:58,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:58,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:58,570 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:58,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:58,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:58,572 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:58,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,573 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,573 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:58,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:58:58,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,574 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,575 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:58:58,575 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:58:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 21:58:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 21:58:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 21:58:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:58:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:58:58,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 21:58:58,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 21:58:58,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 21:58:58,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 21:58:58,583 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:58:58,583 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:58:58,583 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 21:58:58,583 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:58,583 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:58,583 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:58:58,586 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:58:58,586 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:58:58,585 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:58:58,587 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 21:58:58,586 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 21:58:58,588 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:58:58,588 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 21:58:58,587 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 21:58:58,588 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 21:58:58,591 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,591 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:58,593 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,593 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:58:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:58,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:58:58,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@455a61c3[Count = 1] remaining members to acquire global barrier 2023-07-11 21:58:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:58,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 21:58:58,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@455a61c3[Count = 0] remaining members to acquire global barrier 2023-07-11 21:58:58,600 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 21:58:58,600 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,604 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,604 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:58:58,605 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:58,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:58:58,605 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:58:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:58,605 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:58,605 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. started... 2023-07-11 21:58:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:58,605 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:58:58,606 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:58:58,605 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 21:58:58,606 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 21:58:58,606 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ea3586c816343e98966f19e18ed02f1f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 21:58:58,606 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 21:58:58,607 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:58:58,607 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:58:58,607 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:58,607 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. started... 2023-07-11 21:58:58,607 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ebe23c75dcc48b0f0aa092a68f04d0c2 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 21:58:58,611 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:58:58,611 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:58,611 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 21:58:58,761 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/.tmp/cf/9a14534e6cb4496ca9a41e17bc9e6fae 2023-07-11 21:58:58,761 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/.tmp/cf/8e66799af36945d78f93ca4de020b8df 2023-07-11 21:58:58,777 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:58,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:58,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:58:58,779 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:58:58,862 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/.tmp/cf/8e66799af36945d78f93ca4de020b8df as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf/8e66799af36945d78f93ca4de020b8df 2023-07-11 21:58:58,865 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/.tmp/cf/9a14534e6cb4496ca9a41e17bc9e6fae as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf/9a14534e6cb4496ca9a41e17bc9e6fae 2023-07-11 21:58:58,877 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf/9a14534e6cb4496ca9a41e17bc9e6fae, entries=48, sequenceid=6, filesize=8.1 K 2023-07-11 21:58:58,880 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ea3586c816343e98966f19e18ed02f1f in 274ms, sequenceid=6, compaction requested=false 2023-07-11 21:58:58,880 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-11 21:58:58,881 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea3586c816343e98966f19e18ed02f1f: 2023-07-11 21:58:58,882 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:58:58,882 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:58:58,882 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf/9a14534e6cb4496ca9a41e17bc9e6fae] hfiles 2023-07-11 21:58:58,882 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf/9a14534e6cb4496ca9a41e17bc9e6fae for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:58:58,887 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf/8e66799af36945d78f93ca4de020b8df, entries=2, sequenceid=6, filesize=5.0 K 2023-07-11 21:58:58,894 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ebe23c75dcc48b0f0aa092a68f04d0c2 in 287ms, sequenceid=6, compaction requested=false 2023-07-11 21:58:58,896 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebe23c75dcc48b0f0aa092a68f04d0c2: 2023-07-11 21:58:58,896 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:58:58,896 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:58:58,896 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf/8e66799af36945d78f93ca4de020b8df] hfiles 2023-07-11 21:58:58,896 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf/8e66799af36945d78f93ca4de020b8df for snapshot=snaptb0-testExportWithTargetName 2023-07-11 21:58:59,016 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. completed. 2023-07-11 21:58:59,017 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:58:59,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:58:59,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:58:59,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 21:58:59,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 21:58:59,023 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:58:59,023 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,023 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:59,023 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 21:58:59,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:59,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:59,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,030 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. completed. 2023-07-11 21:58:59,030 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:58:59,030 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:58:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,030 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:58:59,031 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,031 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 21:58:59,031 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 21:58:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:59,034 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 21:58:59,034 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:59,034 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 21:58:59,036 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 21:58:59,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 21:58:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:59,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:59,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:59,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,36649,1689112713270': 2023-07-11 21:58:59,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 21:58:59,050 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-11 21:58:59,050 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:58:59,050 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:58:59,050 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-11 21:58:59,050 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:58:59,052 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,052 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:59,052 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:59,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,053 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:59,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:59,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:59,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,058 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,059 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,060 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,060 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:58:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:58:59,066 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:58:59,074 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,075 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:58:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 21:58:59,079 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:58:59,083 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:58:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,106 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:59,106 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:59,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:59,106 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-11 21:58:59,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-11 21:58:59,107 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:58:59,107 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:59,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:58:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:58:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:59,106 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:58:59,106 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:58:59,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,111 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:59,111 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:59,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:59,111 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:58:59,111 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-11 21:58:59,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:58:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:58:59,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 21:58:59,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,474 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 21:58:59,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689112738465Consolidate snapshot: snaptb0-testExportWithTargetName at 1689112739107 (+642 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689112739107Writing data manifest for snaptb0-testExportWithTargetName at 1689112739151 (+44 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689112739237 (+86 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689112739473 (+236 ms) 2023-07-11 21:58:59,478 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 21:58:59,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0110 sec 2023-07-11 21:58:59,583 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:58:59,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 21:58:59,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:58:59,592 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591 2023-07-11 21:58:59,592 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41803, tgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591, rawTgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:58:59,654 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:58:59,655 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_507879439_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 21:58:59,655 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-11 21:58:59,702 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 21:58:59,876 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:58:59,877 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:58:59,877 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:58:59,878 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:01,217 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:59:03,919 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-8801140808373410716.jar 2023-07-11 21:59:03,920 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:03,920 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,030 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-4373030231051898856.jar 2023-07-11 21:59:04,031 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,032 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,033 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,033 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,034 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,034 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:04,035 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:59:04,036 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:59:04,037 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:59:04,038 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:59:04,039 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:59:04,040 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:59:04,041 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:59:04,042 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:59:04,042 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:59:04,043 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:59:04,048 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:04,049 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:04,049 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:59:04,050 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:04,051 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:04,052 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:59:04,058 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:59:07,037 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:59:07,065 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-11 21:59:07,099 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 21:59:08,512 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:59:08,513 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:59:08,936 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0001_000001 (auth:SIMPLE) 2023-07-11 21:59:20,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0001_000001 (auth:SIMPLE) 2023-07-11 21:59:22,756 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0001_000001 (auth:SIMPLE) 2023-07-11 21:59:26,546 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0001_000001 (auth:SIMPLE) 2023-07-11 21:59:28,156 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:59:28,160 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:59:28,168 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-11 21:59:28,168 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:59:28,169 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:59:28,169 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 21:59:28,170 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-11 21:59:28,170 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-11 21:59:28,170 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591/.hbase-snapshot/testExportWithTargetName 2023-07-11 21:59:28,171 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-11 21:59:28,171 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112739591/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-11 21:59:28,182 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-11 21:59:28,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportWithTargetName 2023-07-11 21:59:28,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,210 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112768210"}]},"ts":"1689112768210"} 2023-07-11 21:59:28,212 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-11 21:59:28,215 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-11 21:59:28,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 21:59:28,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, UNASSIGN}] 2023-07-11 21:59:28,220 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, UNASSIGN 2023-07-11 21:59:28,220 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, UNASSIGN 2023-07-11 21:59:28,222 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ebe23c75dcc48b0f0aa092a68f04d0c2, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:28,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ea3586c816343e98966f19e18ed02f1f, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:28,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112768222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112768222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112768222"}]},"ts":"1689112768222"} 2023-07-11 21:59:28,222 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112768222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112768222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112768222"}]},"ts":"1689112768222"} 2023-07-11 21:59:28,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure ebe23c75dcc48b0f0aa092a68f04d0c2, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 21:59:28,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure ea3586c816343e98966f19e18ed02f1f, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:59:28,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 21:59:28,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:59:28,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ebe23c75dcc48b0f0aa092a68f04d0c2, disabling compactions & flushes 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ea3586c816343e98966f19e18ed02f1f, disabling compactions & flushes 2023-07-11 21:59:28,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:59:28,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. after waiting 0 ms 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. after waiting 0 ms 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:59:28,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:59:28,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:59:28,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:59:28,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:59:28,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:59:28,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f. 2023-07-11 21:59:28,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2. 2023-07-11 21:59:28,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ea3586c816343e98966f19e18ed02f1f: 2023-07-11 21:59:28,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ebe23c75dcc48b0f0aa092a68f04d0c2: 2023-07-11 21:59:28,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:59:28,425 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ebe23c75dcc48b0f0aa092a68f04d0c2, regionState=CLOSED 2023-07-11 21:59:28,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:59:28,425 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112768425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112768425"}]},"ts":"1689112768425"} 2023-07-11 21:59:28,426 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ea3586c816343e98966f19e18ed02f1f, regionState=CLOSED 2023-07-11 21:59:28,426 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689112768426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112768426"}]},"ts":"1689112768426"} 2023-07-11 21:59:28,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-11 21:59:28,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure ebe23c75dcc48b0f0aa092a68f04d0c2, server=jenkins-hbase5.apache.org,36649,1689112713270 in 203 msec 2023-07-11 21:59:28,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-11 21:59:28,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure ea3586c816343e98966f19e18ed02f1f, server=jenkins-hbase5.apache.org,34709,1689112713115 in 203 msec 2023-07-11 21:59:28,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebe23c75dcc48b0f0aa092a68f04d0c2, UNASSIGN in 213 msec 2023-07-11 21:59:28,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-11 21:59:28,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ea3586c816343e98966f19e18ed02f1f, UNASSIGN in 213 msec 2023-07-11 21:59:28,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112768437"}]},"ts":"1689112768437"} 2023-07-11 21:59:28,439 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-11 21:59:28,442 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-11 21:59:28,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 252 msec 2023-07-11 21:59:28,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 21:59:28,518 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-11 21:59:28,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportWithTargetName 2023-07-11 21:59:28,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,535 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-11 21:59:28,539 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,541 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-11 21:59:28,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:59:28,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:59:28,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:59:28,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 21:59:28,545 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 21:59:28,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:28,546 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:59:28,546 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:59:28,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 21:59:28,555 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/recovered.edits] 2023-07-11 21:59:28,555 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/recovered.edits] 2023-07-11 21:59:28,565 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf/9a14534e6cb4496ca9a41e17bc9e6fae to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/cf/9a14534e6cb4496ca9a41e17bc9e6fae 2023-07-11 21:59:28,565 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf/8e66799af36945d78f93ca4de020b8df to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/cf/8e66799af36945d78f93ca4de020b8df 2023-07-11 21:59:28,570 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f/recovered.edits/9.seqid 2023-07-11 21:59:28,571 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2/recovered.edits/9.seqid 2023-07-11 21:59:28,571 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ea3586c816343e98966f19e18ed02f1f 2023-07-11 21:59:28,572 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportWithTargetName/ebe23c75dcc48b0f0aa092a68f04d0c2 2023-07-11 21:59:28,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 21:59:28,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,603 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-11 21:59:28,606 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-11 21:59:28,608 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,608 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-11 21:59:28,608 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112768608"}]},"ts":"9223372036854775807"} 2023-07-11 21:59:28,608 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112768608"}]},"ts":"9223372036854775807"} 2023-07-11 21:59:28,610 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:59:28,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ebe23c75dcc48b0f0aa092a68f04d0c2, NAME => 'testtb-testExportWithTargetName,,1689112734718.ebe23c75dcc48b0f0aa092a68f04d0c2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ea3586c816343e98966f19e18ed02f1f, NAME => 'testtb-testExportWithTargetName,1,1689112734718.ea3586c816343e98966f19e18ed02f1f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:59:28,610 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-11 21:59:28,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112768610"}]},"ts":"9223372036854775807"} 2023-07-11 21:59:28,612 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-11 21:59:28,616 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 21:59:28,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-07-11 21:59:28,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 21:59:28,652 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-11 21:59:28,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-11 21:59:28,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-11 21:59:28,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-11 21:59:28,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-11 21:59:28,721 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=736 (was 703) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:57362 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:42953 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (504222127) connection to localhost/127.0.0.1:41803 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-819011128_1 at /127.0.0.1:45560 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1294 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to localhost/127.0.0.1:41803 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:45594 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:33207 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:50690 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 867) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1070 (was 914) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=1005 (was 2318) 2023-07-11 21:59:28,721 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=736 is superior to 500 2023-07-11 21:59:28,748 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=736, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=1070, ProcessCount=182, AvailableMemoryMB=1004 2023-07-11 21:59:28,748 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=736 is superior to 500 2023-07-11 21:59:28,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:59:28,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:28,755 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:59:28,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-11 21:59:28,756 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:59:28,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:59:28,759 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:28,759 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:28,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad empty. 2023-07-11 21:59:28,760 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 empty. 2023-07-11 21:59:28,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:28,760 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:28,760 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 21:59:28,772 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 21:59:28,773 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c57d6c72622a0a784df3d26bf2f51ad, NAME => 'testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:59:28,773 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 18a41bd73221c2d2c3ab1c6cd9cb53e9, NAME => 'testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:59:28,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:28,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1c57d6c72622a0a784df3d26bf2f51ad, disabling compactions & flushes 2023-07-11 21:59:28,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:28,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:28,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. after waiting 0 ms 2023-07-11 21:59:28,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:28,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:28,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1c57d6c72622a0a784df3d26bf2f51ad: 2023-07-11 21:59:28,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:28,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 18a41bd73221c2d2c3ab1c6cd9cb53e9, disabling compactions & flushes 2023-07-11 21:59:28,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:28,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:28,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. after waiting 0 ms 2023-07-11 21:59:28,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:28,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:28,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 18a41bd73221c2d2c3ab1c6cd9cb53e9: 2023-07-11 21:59:28,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:59:28,805 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112768805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112768805"}]},"ts":"1689112768805"} 2023-07-11 21:59:28,805 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112768805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112768805"}]},"ts":"1689112768805"} 2023-07-11 21:59:28,808 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:59:28,809 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:59:28,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112768809"}]},"ts":"1689112768809"} 2023-07-11 21:59:28,811 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 21:59:28,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:59:28,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:59:28,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:59:28,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:59:28,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:59:28,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, ASSIGN}] 2023-07-11 21:59:28,818 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, ASSIGN 2023-07-11 21:59:28,818 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, ASSIGN 2023-07-11 21:59:28,819 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 21:59:28,819 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,34709,1689112713115; forceNewPlan=false, retain=false 2023-07-11 21:59:28,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:59:28,969 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:59:28,973 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=18a41bd73221c2d2c3ab1c6cd9cb53e9, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:28,973 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1c57d6c72622a0a784df3d26bf2f51ad, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:28,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112768973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112768973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112768973"}]},"ts":"1689112768973"} 2023-07-11 21:59:28,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112768973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112768973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112768973"}]},"ts":"1689112768973"} 2023-07-11 21:59:28,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 18a41bd73221c2d2c3ab1c6cd9cb53e9, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:59:28,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 1c57d6c72622a0a784df3d26bf2f51ad, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 21:59:29,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:59:29,132 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,132 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:59:29,137 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:59:29,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:29,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18a41bd73221c2d2c3ab1c6cd9cb53e9, NAME => 'testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:59:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. service=AccessControlService 2023-07-11 21:59:29,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:59:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c57d6c72622a0a784df3d26bf2f51ad, NAME => 'testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:59:29,157 INFO [StoreOpener-18a41bd73221c2d2c3ab1c6cd9cb53e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. service=AccessControlService 2023-07-11 21:59:29,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:59:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,159 DEBUG [StoreOpener-18a41bd73221c2d2c3ab1c6cd9cb53e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf 2023-07-11 21:59:29,159 DEBUG [StoreOpener-18a41bd73221c2d2c3ab1c6cd9cb53e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf 2023-07-11 21:59:29,159 INFO [StoreOpener-18a41bd73221c2d2c3ab1c6cd9cb53e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18a41bd73221c2d2c3ab1c6cd9cb53e9 columnFamilyName cf 2023-07-11 21:59:29,160 INFO [StoreOpener-18a41bd73221c2d2c3ab1c6cd9cb53e9-1] regionserver.HStore(310): Store=18a41bd73221c2d2c3ab1c6cd9cb53e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:59:29,164 INFO [StoreOpener-1c57d6c72622a0a784df3d26bf2f51ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,168 DEBUG [StoreOpener-1c57d6c72622a0a784df3d26bf2f51ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf 2023-07-11 21:59:29,168 DEBUG [StoreOpener-1c57d6c72622a0a784df3d26bf2f51ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf 2023-07-11 21:59:29,168 INFO [StoreOpener-1c57d6c72622a0a784df3d26bf2f51ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c57d6c72622a0a784df3d26bf2f51ad columnFamilyName cf 2023-07-11 21:59:29,169 INFO [StoreOpener-1c57d6c72622a0a784df3d26bf2f51ad-1] regionserver.HStore(310): Store=1c57d6c72622a0a784df3d26bf2f51ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:59:29,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:29,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:59:29,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 18a41bd73221c2d2c3ab1c6cd9cb53e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63796574, jitterRate=-0.04935696721076965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:59:29,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 18a41bd73221c2d2c3ab1c6cd9cb53e9: 2023-07-11 21:59:29,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9., pid=30, masterSystemTime=1689112769132 2023-07-11 21:59:29,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:29,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:29,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:29,181 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=18a41bd73221c2d2c3ab1c6cd9cb53e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,181 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112769181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112769181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112769181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112769181"}]},"ts":"1689112769181"} 2023-07-11 21:59:29,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-11 21:59:29,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 18a41bd73221c2d2c3ab1c6cd9cb53e9, server=jenkins-hbase5.apache.org,34709,1689112713115 in 207 msec 2023-07-11 21:59:29,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, ASSIGN in 371 msec 2023-07-11 21:59:29,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:59:29,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1c57d6c72622a0a784df3d26bf2f51ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61252999, jitterRate=-0.0872591882944107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:59:29,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1c57d6c72622a0a784df3d26bf2f51ad: 2023-07-11 21:59:29,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad., pid=31, masterSystemTime=1689112769132 2023-07-11 21:59:29,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:29,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:29,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1c57d6c72622a0a784df3d26bf2f51ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112769206"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112769206"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112769206"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112769206"}]},"ts":"1689112769206"} 2023-07-11 21:59:29,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-11 21:59:29,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 1c57d6c72622a0a784df3d26bf2f51ad, server=jenkins-hbase5.apache.org,37459,1689112712887 in 232 msec 2023-07-11 21:59:29,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-11 21:59:29,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, ASSIGN in 402 msec 2023-07-11 21:59:29,234 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:59:29,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112769234"}]},"ts":"1689112769234"} 2023-07-11 21:59:29,243 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 21:59:29,252 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:59:29,252 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-11 21:59:29,255 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:59:29,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:29,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:29,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:29,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:29,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:29,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:29,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 510 msec 2023-07-11 21:59:29,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:29,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:29,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 21:59:29,361 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-11 21:59:29,362 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-11 21:59:29,362 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:59:29,366 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-11 21:59:29,367 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:59:29,367 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-11 21:59:29,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:59:29,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112769370 (current time:1689112769370). 2023-07-11 21:59:29,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:59:29,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x77473635 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:59:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55c5d644, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:59:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:29,398 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:58716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77473635 to 127.0.0.1:58667 2023-07-11 21:59:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:59:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x24402dec to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:59:29,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6af841cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:59:29,425 DEBUG [hconnection-0x1174cd22-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:29,426 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:58724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:29,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24402dec to 127.0.0.1:58667 2023-07-11 21:59:29,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:59:29,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:59:29,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:59:29,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:59:29,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:59:29,458 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:59:29,468 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689113369468 2023-07-11 21:59:29,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:59:29,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 21:59:29,472 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:59:29,472 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:59:29,474 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:59:29,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:59:29,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 19 msec 2023-07-11 21:59:29,478 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:59:29,489 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689113369489 2023-07-11 21:59:29,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,549 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-11 21:59:29,549 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:29,551 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 21:59:29,551 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 21:59:29,551 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,551 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:29,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:29,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:29,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:29,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:29,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:29,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:29,554 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,555 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,555 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,556 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,556 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:59:29,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 21:59:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:59:29,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,559 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:59:29,559 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:29,561 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:59:29,561 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:59:29,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,561 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 21:59:29,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,561 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:59:29,561 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:29,561 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:59:29,564 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:59:29,564 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:59:29,564 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 21:59:29,564 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:29,566 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:59:29,566 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:59:29,566 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 21:59:29,567 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:29,567 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,571 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:29,571 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,571 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:29,572 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:29,573 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,574 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,574 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,574 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,574 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:29,574 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:59:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:29,575 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:59:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:29,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:29,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:59:29,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51a10e8b[Count = 1] remaining members to acquire global barrier 2023-07-11 21:59:29,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:29,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:29,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:29,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:29,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:29,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:29,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:59:29,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51a10e8b[Count = 0] remaining members to acquire global barrier 2023-07-11 21:59:29,588 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 21:59:29,588 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,589 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,589 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,589 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:59:29,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:59:29,590 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:29,590 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:59:29,590 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,590 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. started... 2023-07-11 21:59:29,591 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:59:29,591 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:59:29,591 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,591 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:59:29,592 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:29,592 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. started... 2023-07-11 21:59:29,593 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:59:29,593 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:29,593 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 21:59:29,614 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18a41bd73221c2d2c3ab1c6cd9cb53e9: 2023-07-11 21:59:29,614 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,614 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:59:29,614 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:59:29,615 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c57d6c72622a0a784df3d26bf2f51ad: 2023-07-11 21:59:29,615 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,615 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:59:29,615 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:59:29,715 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. completed. 2023-07-11 21:59:29,715 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:29,715 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:59:29,715 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:59:29,715 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,715 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 21:59:29,715 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 21:59:29,717 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:59:29,717 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:29,717 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 21:59:29,719 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:29,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:29,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:29,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:29,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:29,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:29,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:29,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:29,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:29,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 21:59:29,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 21:59:29,775 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:29,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:59:29,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:29,777 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:59:30,077 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:30,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:59:30,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:30,079 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:59:30,089 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. completed. 2023-07-11 21:59:30,089 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:30,089 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:59:30,089 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:59:30,090 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,090 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 21:59:30,090 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 21:59:30,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,101 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:59:30,101 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:30,101 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 21:59:30,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 21:59:30,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 21:59:30,110 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-11 21:59:30,110 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:59:30,110 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:59:30,110 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,110 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:59:30,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,112 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,113 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,113 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,115 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,116 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,117 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,123 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,125 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,128 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,133 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,133 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,133 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,133 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,133 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,134 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,134 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:30,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,135 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,138 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,138 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,138 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,138 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 21:59:30,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,259 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:30,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689112769469Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689112770135 (+666 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689112770135Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689112770171 (+36 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689112770196 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689112770258 (+62 ms) 2023-07-11 21:59:30,262 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:59:30,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 790 msec 2023-07-11 21:59:30,314 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-11 21:59:30,579 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:30,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:59:30,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:59:30,589 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:30,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34709] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:59:30,601 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:30,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37459] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 21:59:30,606 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 21:59:30,606 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:30,607 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:59:30,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:59:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112770621 (current time:1689112770621). 2023-07-11 21:59:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:59:30,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x0a7a147d to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:59:30,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@193bcd76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:59:30,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:30,635 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:58732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:30,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a7a147d to 127.0.0.1:58667 2023-07-11 21:59:30,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:59:30,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x475180f7 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:59:30,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ac5832d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:59:30,646 DEBUG [hconnection-0x3cae8038-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:30,649 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:58742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:30,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x475180f7 to 127.0.0.1:58667 2023-07-11 21:59:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:59:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 21:59:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:59:30,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:59:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:59:30,658 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:59:30,660 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689113370660 2023-07-11 21:59:30,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 21:59:30,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 21:59:30,661 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:59:30,662 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:59:30,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:59:30,663 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 21:59:30,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-11 21:59:30,666 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:59:30,666 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689113370666 2023-07-11 21:59:30,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-11 21:59:30,683 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-11 21:59:30,683 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:30,685 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 21:59:30,685 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 21:59:30,685 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,685 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,686 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,687 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,687 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,686 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,687 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,687 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,688 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,689 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:59:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 21:59:30,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:59:30,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 21:59:30,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 21:59:30,689 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:59:30,689 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:30,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:59:30,692 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:59:30,692 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:59:30,692 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 21:59:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 21:59:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 21:59:30,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 21:59:30,693 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:59:30,693 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:30,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 21:59:30,695 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:59:30,695 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 21:59:30,695 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:59:30,695 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 21:59:30,695 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:30,696 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 21:59:30,696 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 21:59:30,696 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 21:59:30,697 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,698 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,698 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,698 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:30,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,699 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:30,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:59:30,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47e33905[Count = 1] remaining members to acquire global barrier 2023-07-11 21:59:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 21:59:30,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47e33905[Count = 0] remaining members to acquire global barrier 2023-07-11 21:59:30,705 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 21:59:30,705 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,706 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,706 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,706 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:59:30,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,707 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:59:30,707 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 21:59:30,707 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:59:30,707 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:59:30,708 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:59:30,708 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:59:30,707 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,708 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:59:30,708 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:30,707 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:30,707 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 21:59:30,708 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. started... 2023-07-11 21:59:30,708 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 21:59:30,708 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. started... 2023-07-11 21:59:30,708 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1c57d6c72622a0a784df3d26bf2f51ad 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 21:59:30,708 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18a41bd73221c2d2c3ab1c6cd9cb53e9 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 21:59:30,710 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:59:30,710 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:30,710 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 21:59:30,731 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/.tmp/cf/24efe4aba1634694b431fc4d5120f6ab 2023-07-11 21:59:30,731 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/.tmp/cf/e66a2afcc8c04ca2ba27576e7cb176b6 2023-07-11 21:59:30,756 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/.tmp/cf/24efe4aba1634694b431fc4d5120f6ab as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf/24efe4aba1634694b431fc4d5120f6ab 2023-07-11 21:59:30,756 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/.tmp/cf/e66a2afcc8c04ca2ba27576e7cb176b6 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf/e66a2afcc8c04ca2ba27576e7cb176b6 2023-07-11 21:59:30,762 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:30,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:59:30,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:30,767 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:59:30,769 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf/24efe4aba1634694b431fc4d5120f6ab, entries=3, sequenceid=6, filesize=5.0 K 2023-07-11 21:59:30,770 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 1c57d6c72622a0a784df3d26bf2f51ad in 62ms, sequenceid=6, compaction requested=false 2023-07-11 21:59:30,781 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c57d6c72622a0a784df3d26bf2f51ad: 2023-07-11 21:59:30,781 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:59:30,781 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:59:30,781 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf/24efe4aba1634694b431fc4d5120f6ab] hfiles 2023-07-11 21:59:30,782 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf/24efe4aba1634694b431fc4d5120f6ab for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:59:30,785 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf/e66a2afcc8c04ca2ba27576e7cb176b6, entries=47, sequenceid=6, filesize=8 K 2023-07-11 21:59:30,791 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 18a41bd73221c2d2c3ab1c6cd9cb53e9 in 83ms, sequenceid=6, compaction requested=false 2023-07-11 21:59:30,791 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18a41bd73221c2d2c3ab1c6cd9cb53e9: 2023-07-11 21:59:30,792 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:59:30,792 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:59:30,792 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf/e66a2afcc8c04ca2ba27576e7cb176b6] hfiles 2023-07-11 21:59:30,792 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf/e66a2afcc8c04ca2ba27576e7cb176b6 for snapshot=snaptb0-testExportFileSystemState 2023-07-11 21:59:30,811 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. completed. 2023-07-11 21:59:30,811 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:30,811 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:59:30,812 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:59:30,812 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,816 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 21:59:30,816 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 21:59:30,824 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,824 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:59:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,824 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:30,824 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 21:59:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,828 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. completed. 2023-07-11 21:59:30,828 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:30,828 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:59:30,828 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:59:30,828 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,828 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 21:59:30,828 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 21:59:30,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,830 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 21:59:30,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,830 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:30,830 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,830 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 21:59:30,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 21:59:30,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 21:59:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 21:59:30,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 21:59:30,841 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-11 21:59:30,841 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:59:30,841 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:59:30,841 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-11 21:59:30,841 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:59:30,843 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,843 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:30,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,843 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,843 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,843 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,844 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,844 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,844 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:30,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,845 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,845 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,849 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,849 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:30,849 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 21:59:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,858 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,859 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,859 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:30,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-11 21:59:30,865 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:30,865 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:30,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-11 21:59:30,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-11 21:59:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:30,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 21:59:30,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,949 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:59:30,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689112770660Consolidate snapshot: snaptb0-testExportFileSystemState at 1689112770865 (+205 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689112770865Writing data manifest for snaptb0-testExportFileSystemState at 1689112770871 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689112770884 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689112770947 (+63 ms) 2023-07-11 21:59:30,953 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 21:59:30,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 292 msec 2023-07-11 21:59:30,967 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:30,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 21:59:30,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 21:59:30,971 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971 2023-07-11 21:59:30,971 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41803, tgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971, rawTgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:59:31,002 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 21:59:31,002 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_856312271_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:59:31,002 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-11 21:59:31,027 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 21:59:31,094 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:31,095 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:31,095 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:31,096 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,254 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-272547743518168031.jar 2023-07-11 21:59:32,254 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,255 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,335 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-5878897597688081040.jar 2023-07-11 21:59:32,335 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,336 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,336 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,337 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,337 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,337 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 21:59:32,338 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 21:59:32,338 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 21:59:32,339 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 21:59:32,340 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 21:59:32,340 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 21:59:32,341 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 21:59:32,341 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 21:59:32,342 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 21:59:32,342 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 21:59:32,343 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 21:59:32,344 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:32,345 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:32,345 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:59:32,346 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:32,346 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 21:59:32,347 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:59:32,348 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 21:59:32,902 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0001_000001 (auth:SIMPLE) 2023-07-11 21:59:34,005 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 21:59:34,500 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 21:59:34,520 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-11 21:59:34,525 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 21:59:34,858 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:59:34,858 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 21:59:34,885 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0002_000001 (auth:SIMPLE) 2023-07-11 21:59:43,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0002_000001 (auth:SIMPLE) 2023-07-11 21:59:46,079 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0002_000001 (auth:SIMPLE) 2023-07-11 21:59:55,165 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 21:59:55,178 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 21:59:55,254 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-11 21:59:55,254 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 21:59:55,260 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 21:59:55,261 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 21:59:55,261 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 21:59:55,261 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 21:59:55,262 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 21:59:55,262 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 21:59:55,262 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112770971/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 21:59:55,274 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-11 21:59:55,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemState 2023-07-11 21:59:55,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:55,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:59:55,331 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112795330"}]},"ts":"1689112795330"} 2023-07-11 21:59:55,338 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 21:59:55,341 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-11 21:59:55,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, UNASSIGN}] 2023-07-11 21:59:55,355 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, UNASSIGN 2023-07-11 21:59:55,355 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, UNASSIGN 2023-07-11 21:59:55,356 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=18a41bd73221c2d2c3ab1c6cd9cb53e9, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:55,356 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1c57d6c72622a0a784df3d26bf2f51ad, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:55,356 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112795356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112795356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112795356"}]},"ts":"1689112795356"} 2023-07-11 21:59:55,357 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112795356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112795356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112795356"}]},"ts":"1689112795356"} 2023-07-11 21:59:55,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 18a41bd73221c2d2c3ab1c6cd9cb53e9, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:59:55,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 1c57d6c72622a0a784df3d26bf2f51ad, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 21:59:55,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:59:55,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:55,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 18a41bd73221c2d2c3ab1c6cd9cb53e9, disabling compactions & flushes 2023-07-11 21:59:55,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:55,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:55,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. after waiting 0 ms 2023-07-11 21:59:55,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:55,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:55,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1c57d6c72622a0a784df3d26bf2f51ad, disabling compactions & flushes 2023-07-11 21:59:55,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:55,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:55,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. after waiting 0 ms 2023-07-11 21:59:55,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:55,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:59:55,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:59:55,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:59:55,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad. 2023-07-11 21:59:55,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1c57d6c72622a0a784df3d26bf2f51ad: 2023-07-11 21:59:55,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:55,664 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1c57d6c72622a0a784df3d26bf2f51ad, regionState=CLOSED 2023-07-11 21:59:55,664 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112795664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112795664"}]},"ts":"1689112795664"} 2023-07-11 21:59:55,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:59:55,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 21:59:55,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9. 2023-07-11 21:59:55,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 18a41bd73221c2d2c3ab1c6cd9cb53e9: 2023-07-11 21:59:55,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-11 21:59:55,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 1c57d6c72622a0a784df3d26bf2f51ad, server=jenkins-hbase5.apache.org,37459,1689112712887 in 299 msec 2023-07-11 21:59:55,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:55,684 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=18a41bd73221c2d2c3ab1c6cd9cb53e9, regionState=CLOSED 2023-07-11 21:59:55,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c57d6c72622a0a784df3d26bf2f51ad, UNASSIGN in 335 msec 2023-07-11 21:59:55,684 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689112795684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112795684"}]},"ts":"1689112795684"} 2023-07-11 21:59:55,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-11 21:59:55,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 18a41bd73221c2d2c3ab1c6cd9cb53e9, server=jenkins-hbase5.apache.org,34709,1689112713115 in 323 msec 2023-07-11 21:59:55,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-11 21:59:55,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18a41bd73221c2d2c3ab1c6cd9cb53e9, UNASSIGN in 347 msec 2023-07-11 21:59:55,695 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112795694"}]},"ts":"1689112795694"} 2023-07-11 21:59:55,696 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 21:59:55,701 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-11 21:59:55,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 413 msec 2023-07-11 21:59:55,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 21:59:55,946 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-11 21:59:55,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemState 2023-07-11 21:59:55,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:55,957 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:55,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-11 21:59:55,960 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:55,963 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-11 21:59:55,966 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:59:55,966 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:59:55,966 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:59:55,967 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:59:55,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 21:59:55,968 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:55,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-11 21:59:55,968 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 21:59:55,968 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:55,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-11 21:59:55,969 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 21:59:55,969 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:55,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-11 21:59:55,969 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 21:59:55,969 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 21:59:55,969 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:55,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 21:59:55,991 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:55,995 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/recovered.edits] 2023-07-11 21:59:55,995 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:56,001 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf/24efe4aba1634694b431fc4d5120f6ab to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/cf/24efe4aba1634694b431fc4d5120f6ab 2023-07-11 21:59:56,005 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad/recovered.edits/9.seqid 2023-07-11 21:59:56,006 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/1c57d6c72622a0a784df3d26bf2f51ad 2023-07-11 21:59:56,022 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/recovered.edits] 2023-07-11 21:59:56,034 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf/e66a2afcc8c04ca2ba27576e7cb176b6 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/cf/e66a2afcc8c04ca2ba27576e7cb176b6 2023-07-11 21:59:56,038 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9/recovered.edits/9.seqid 2023-07-11 21:59:56,039 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemState/18a41bd73221c2d2c3ab1c6cd9cb53e9 2023-07-11 21:59:56,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 21:59:56,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:56,068 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-11 21:59:56,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 21:59:56,084 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-11 21:59:56,087 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:56,087 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-11 21:59:56,087 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112796087"}]},"ts":"9223372036854775807"} 2023-07-11 21:59:56,087 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112796087"}]},"ts":"9223372036854775807"} 2023-07-11 21:59:56,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 21:59:56,115 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1c57d6c72622a0a784df3d26bf2f51ad, NAME => 'testtb-testExportFileSystemState,,1689112768750.1c57d6c72622a0a784df3d26bf2f51ad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 18a41bd73221c2d2c3ab1c6cd9cb53e9, NAME => 'testtb-testExportFileSystemState,1,1689112768750.18a41bd73221c2d2c3ab1c6cd9cb53e9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 21:59:56,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-11 21:59:56,116 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112796115"}]},"ts":"9223372036854775807"} 2023-07-11 21:59:56,126 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-11 21:59:56,132 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 21:59:56,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 185 msec 2023-07-11 21:59:56,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 21:59:56,288 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-11 21:59:56,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-11 21:59:56,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-11 21:59:56,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-11 21:59:56,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-11 21:59:56,409 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=737 (was 736) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1787498447_1 at /127.0.0.1:34128 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (504222127) connection to localhost/127.0.0.1:41803 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:40407 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:38014 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:34146 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:50662 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=890 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1156 (was 1070) - SystemLoadAverage LEAK? -, ProcessCount=191 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=2630 (was 1004) - AvailableMemoryMB LEAK? - 2023-07-11 21:59:56,410 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=737 is superior to 500 2023-07-11 21:59:56,478 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=737, OpenFileDescriptor=890, MaxFileDescriptor=60000, SystemLoadAverage=1156, ProcessCount=190, AvailableMemoryMB=2624 2023-07-11 21:59:56,478 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=737 is superior to 500 2023-07-11 21:59:56,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:59:56,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-11 21:59:56,493 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:59:56,493 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-11 21:59:56,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:59:56,501 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:59:56,580 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:56,581 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 empty. 2023-07-11 21:59:56,582 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:56,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:59:56,603 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:56,604 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb empty. 2023-07-11 21:59:56,605 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:56,605 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 21:59:56,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:59:56,826 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-11 21:59:56,845 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d72903b5e5f56146bf7b082b4bee9919, NAME => 'testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:59:56,846 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec2f47f9d5936015fdf646328a8d88fb, NAME => 'testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 21:59:57,094 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:57,097 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d72903b5e5f56146bf7b082b4bee9919, disabling compactions & flushes 2023-07-11 21:59:57,097 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,097 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,097 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. after waiting 0 ms 2023-07-11 21:59:57,098 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,098 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,098 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d72903b5e5f56146bf7b082b4bee9919: 2023-07-11 21:59:57,095 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:57,102 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ec2f47f9d5936015fdf646328a8d88fb, disabling compactions & flushes 2023-07-11 21:59:57,102 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,102 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,102 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. after waiting 0 ms 2023-07-11 21:59:57,102 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,102 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,102 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ec2f47f9d5936015fdf646328a8d88fb: 2023-07-11 21:59:57,106 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:59:57,108 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112797107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112797107"}]},"ts":"1689112797107"} 2023-07-11 21:59:57,108 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112797107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112797107"}]},"ts":"1689112797107"} 2023-07-11 21:59:57,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:59:57,121 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 21:59:57,123 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:59:57,123 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112797123"}]},"ts":"1689112797123"} 2023-07-11 21:59:57,125 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-11 21:59:57,128 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 21:59:57,130 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 21:59:57,130 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 21:59:57,130 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 21:59:57,130 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 21:59:57,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, ASSIGN}] 2023-07-11 21:59:57,135 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, ASSIGN 2023-07-11 21:59:57,135 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, ASSIGN 2023-07-11 21:59:57,136 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,34709,1689112713115; forceNewPlan=false, retain=false 2023-07-11 21:59:57,136 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 21:59:57,287 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 21:59:57,293 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ec2f47f9d5936015fdf646328a8d88fb, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:57,293 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112797293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112797293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112797293"}]},"ts":"1689112797293"} 2023-07-11 21:59:57,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d72903b5e5f56146bf7b082b4bee9919, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:57,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112797293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112797293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112797293"}]},"ts":"1689112797293"} 2023-07-11 21:59:57,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure ec2f47f9d5936015fdf646328a8d88fb, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 21:59:57,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure d72903b5e5f56146bf7b082b4bee9919, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 21:59:57,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec2f47f9d5936015fdf646328a8d88fb, NAME => 'testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 21:59:57,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. service=AccessControlService 2023-07-11 21:59:57,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:59:57,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d72903b5e5f56146bf7b082b4bee9919, NAME => 'testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 21:59:57,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:57,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. service=AccessControlService 2023-07-11 21:59:57,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 21:59:57,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:59:57,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,484 INFO [StoreOpener-ec2f47f9d5936015fdf646328a8d88fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,485 INFO [StoreOpener-d72903b5e5f56146bf7b082b4bee9919-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,487 DEBUG [StoreOpener-d72903b5e5f56146bf7b082b4bee9919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf 2023-07-11 21:59:57,487 DEBUG [StoreOpener-d72903b5e5f56146bf7b082b4bee9919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf 2023-07-11 21:59:57,488 INFO [StoreOpener-d72903b5e5f56146bf7b082b4bee9919-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d72903b5e5f56146bf7b082b4bee9919 columnFamilyName cf 2023-07-11 21:59:57,490 INFO [StoreOpener-d72903b5e5f56146bf7b082b4bee9919-1] regionserver.HStore(310): Store=d72903b5e5f56146bf7b082b4bee9919/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:59:57,491 DEBUG [StoreOpener-ec2f47f9d5936015fdf646328a8d88fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf 2023-07-11 21:59:57,501 DEBUG [StoreOpener-ec2f47f9d5936015fdf646328a8d88fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf 2023-07-11 21:59:57,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,502 INFO [StoreOpener-ec2f47f9d5936015fdf646328a8d88fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec2f47f9d5936015fdf646328a8d88fb columnFamilyName cf 2023-07-11 21:59:57,503 INFO [StoreOpener-ec2f47f9d5936015fdf646328a8d88fb-1] regionserver.HStore(310): Store=ec2f47f9d5936015fdf646328a8d88fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:59:57,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for d72903b5e5f56146bf7b082b4bee9919 2023-07-11 21:59:57,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 21:59:57,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:59:57,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened d72903b5e5f56146bf7b082b4bee9919; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62113325, jitterRate=-0.07443933188915253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:59:57,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for d72903b5e5f56146bf7b082b4bee9919: 2023-07-11 21:59:57,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919., pid=46, masterSystemTime=1689112797456 2023-07-11 21:59:57,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:57,531 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d72903b5e5f56146bf7b082b4bee9919, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:57,531 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112797531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112797531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112797531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112797531"}]},"ts":"1689112797531"} 2023-07-11 21:59:57,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-11 21:59:57,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure d72903b5e5f56146bf7b082b4bee9919, server=jenkins-hbase5.apache.org,37459,1689112712887 in 233 msec 2023-07-11 21:59:57,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:59:57,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ec2f47f9d5936015fdf646328a8d88fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67971655, jitterRate=0.012856587767601013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:59:57,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ec2f47f9d5936015fdf646328a8d88fb: 2023-07-11 21:59:57,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, ASSIGN in 406 msec 2023-07-11 21:59:57,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb., pid=45, masterSystemTime=1689112797454 2023-07-11 21:59:57,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:57,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ec2f47f9d5936015fdf646328a8d88fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:57,547 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112797547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112797547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112797547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112797547"}]},"ts":"1689112797547"} 2023-07-11 21:59:57,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-11 21:59:57,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure ec2f47f9d5936015fdf646328a8d88fb, server=jenkins-hbase5.apache.org,34709,1689112713115 in 251 msec 2023-07-11 21:59:57,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-11 21:59:57,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, ASSIGN in 429 msec 2023-07-11 21:59:57,582 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:59:57,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112797582"}]},"ts":"1689112797582"} 2023-07-11 21:59:57,585 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-11 21:59:57,588 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:59:57,589 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-11 21:59:57,591 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 21:59:57,593 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:57,593 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:57,593 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:57,595 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 21:59:57,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:57,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:57,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:57,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 21:59:57,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 1.1110 sec 2023-07-11 21:59:57,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 21:59:57,620 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-11 21:59:57,621 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-11 21:59:57,621 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:59:57,661 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-11 21:59:57,662 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:59:57,662 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-11 21:59:57,679 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:59:57,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112797679 (current time:1689112797679). 2023-07-11 21:59:57,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 21:59:57,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x07413e5c to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:59:57,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fa7709e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:59:57,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:57,742 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:57,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07413e5c to 127.0.0.1:58667 2023-07-11 21:59:57,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:59:57,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x5e7c156e to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:59:57,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50417323, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:59:57,871 DEBUG [hconnection-0x6456ca35-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:59:57,887 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:59:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e7c156e to 127.0.0.1:58667 2023-07-11 21:59:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:59:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 21:59:57,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 21:59:57,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:59:57,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:59:57,912 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:59:57,913 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689113397913 2023-07-11 21:59:57,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 21:59:57,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 21:59:57,916 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 21:59:57,924 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 21:59:57,923 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 21:59:57,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:59:57,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 15 msec 2023-07-11 21:59:57,944 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:59:57,949 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689113397949 2023-07-11 21:59:58,027 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:58,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:59:58,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:58,029 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 21:59:58,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,112 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-11 21:59:58,112 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:58,112 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 21:59:58,112 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 21:59:58,113 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,113 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,114 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,114 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:58,114 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:58,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:58,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:58,115 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,114 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:58,115 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,116 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,116 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:59:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:59:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 21:59:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 21:59:58,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,134 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:59:58,134 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:58,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,174 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:59:58,174 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 21:59:58,174 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:58,157 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:59:58,177 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:59:58,174 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 21:59:58,177 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:59:58,177 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:59:58,177 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 21:59:58,177 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 21:59:58,187 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 21:59:58,187 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 21:59:58,187 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 21:59:58,189 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,189 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,189 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:58,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:58,192 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,192 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,192 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:58,192 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:58,193 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,193 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:58,193 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,193 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:59:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:58,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 21:59:58,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eab425[Count = 1] remaining members to acquire global barrier 2023-07-11 21:59:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:58,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 21:59:58,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eab425[Count = 0] remaining members to acquire global barrier 2023-07-11 21:59:58,200 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 21:59:58,200 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,203 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,203 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,204 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:59:58,204 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 21:59:58,204 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 21:59:58,204 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:59:58,204 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,205 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 21:59:58,207 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:59:58,208 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:59:58,208 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:58,208 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:59:58,208 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:58,208 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 21:59:58,208 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,209 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,209 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:59:58,209 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 21:59:58,209 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 21:59:58,208 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. started... 2023-07-11 21:59:58,259 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:58,260 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:58,260 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. started... 2023-07-11 21:59:58,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:59:58,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:58,262 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 21:59:58,281 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d72903b5e5f56146bf7b082b4bee9919: 2023-07-11 21:59:58,282 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,284 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec2f47f9d5936015fdf646328a8d88fb: 2023-07-11 21:59:58,284 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,284 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:59:58,284 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:59:58,284 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 21:59:58,284 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 21:59:58,624 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:58,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:59:58,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:58,626 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 21:59:58,632 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. completed. 2023-07-11 21:59:58,633 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 21:59:58,633 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:59:58,633 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:59:58,633 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,633 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 21:59:58,633 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 21:59:58,635 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,635 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:59:58,635 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:58,635 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 21:59:58,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:58,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:58,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:58,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,640 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. completed. 2023-07-11 21:59:58,640 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 21:59:58,640 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 21:59:58,640 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 21:59:58,640 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,640 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 21:59:58,641 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 21:59:58,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,643 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 21:59:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,643 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:58,643 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,643 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 21:59:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 21:59:58,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 21:59:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:58,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 21:59:58,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 21:59:58,663 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-11 21:59:58,663 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:59:58,663 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:59:58,663 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,663 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 21:59:58,673 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:59:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 21:59:58,673 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,673 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,674 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,674 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:59:58,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:58,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:58,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,675 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:59:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:58,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,676 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:58,676 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,685 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,686 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,686 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:59:58,690 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:58,690 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:58,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:58,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:58,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:58,691 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:58,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:58,690 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:58,690 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 21:59:58,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:58,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:58,691 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:59:58,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 21:59:58,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:59:58,691 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 21:59:58,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,698 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,698 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,698 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,698 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:58,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 21:59:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:58,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-11 21:59:58,698 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,700 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 21:59:58,700 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,700 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 21:59:58,701 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 21:59:58,701 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,701 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:59:58,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:59,127 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 21:59:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 21:59:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 21:59:59,129 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 21:59:59,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 21:59:59,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:59,218 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 21:59:59,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689112797915Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689112798691 (+776 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689112798691Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689112798727 (+36 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689112798885 (+158 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689112799218 (+333 ms) 2023-07-11 21:59:59,224 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 21:59:59,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.3080 sec 2023-07-11 21:59:59,733 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0002_000001 (auth:SIMPLE) 2023-07-11 22:00:00,129 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:00:00,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 22:00:00,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:00:00,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37459] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:00:00,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34709] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:00:00,235 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 22:00:00,235 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:00:00,235 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:00:00,314 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 22:00:00,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112800314 (current time:1689112800314). 2023-07-11 22:00:00,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:00:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x6b0e339a to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:00:00,317 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-11 22:00:00,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@200ad6ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:00:00,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:00:00,375 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:00:00,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b0e339a to 127.0.0.1:58667 2023-07-11 22:00:00,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:00:00,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x598d54d3 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:00:00,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43852e9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:00:00,427 DEBUG [hconnection-0x35cea53a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:00:00,430 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:00:00,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x598d54d3 to 127.0.0.1:58667 2023-07-11 22:00:00,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:00:00,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 22:00:00,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:00:00,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 22:00:00,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 22:00:00,451 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 22:00:00,452 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689113400452 2023-07-11 22:00:00,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 22:00:00,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 22:00:00,459 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:00:00,460 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:00:00,464 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 22:00:00,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 22:00:00,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 17 msec 2023-07-11 22:00:00,469 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 22:00:00,470 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689113400470 2023-07-11 22:00:00,560 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:00:00,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 22:00:00,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:00:00,562 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:00:00,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-11 22:00:00,601 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-11 22:00:00,601 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:00:00,601 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 22:00:00,601 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 22:00:00,602 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,602 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,604 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:00:00,604 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:00:00,604 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:00:00,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:00:00,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:00:00,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:00:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:00:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:00:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:00:00,604 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 22:00:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 22:00:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 22:00:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 22:00:00,608 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,608 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,608 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,608 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:00:00,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 22:00:00,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 22:00:00,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 22:00:00,627 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 22:00:00,627 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:00:00,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 22:00:00,634 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 22:00:00,638 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 22:00:00,638 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 22:00:00,638 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 22:00:00,638 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:00:00,640 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 22:00:00,647 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,648 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:00:00,648 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 22:00:00,648 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:00:00,665 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 22:00:00,665 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 22:00:00,665 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 22:00:00,665 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 22:00:00,665 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 22:00:00,665 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 22:00:00,668 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,668 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,668 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,668 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:00:00,668 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,669 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:00:00,670 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,670 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:00:00,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:00:00,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:00:00,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:00:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:00,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:00,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:00:00,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 22:00:00,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@136d0ebc[Count = 1] remaining members to acquire global barrier 2023-07-11 22:00:00,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:00:00,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:00:00,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:00:00,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:00:00,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:00,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:00,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:00:00,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 22:00:00,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@136d0ebc[Count = 0] remaining members to acquire global barrier 2023-07-11 22:00:00,700 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 22:00:00,701 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 22:00:00,702 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,703 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 22:00:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:00,703 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 22:00:00,703 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 22:00:00,703 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:00:00,704 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:00,705 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 22:00:00,705 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:00:00,705 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 22:00:00,705 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:00,705 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:00:00,719 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:00:00,719 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:00:00,719 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 22:00:00,719 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. started... 2023-07-11 22:00:00,720 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec2f47f9d5936015fdf646328a8d88fb 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 22:00:00,728 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:00:00,728 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:00:00,728 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:00:00,728 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. started... 2023-07-11 22:00:00,729 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d72903b5e5f56146bf7b082b4bee9919 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 22:00:00,762 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:00:00,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 22:00:00,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:00:00,764 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:00:00,970 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/.tmp/cf/49d35bbb305d47ba9d17f612c4e63305 2023-07-11 22:00:00,976 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/.tmp/cf/6d9821e4d33c42b2a8d97fda0691154f 2023-07-11 22:00:00,989 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/.tmp/cf/6d9821e4d33c42b2a8d97fda0691154f as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf/6d9821e4d33c42b2a8d97fda0691154f 2023-07-11 22:00:00,991 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/.tmp/cf/49d35bbb305d47ba9d17f612c4e63305 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf/49d35bbb305d47ba9d17f612c4e63305 2023-07-11 22:00:00,998 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf/6d9821e4d33c42b2a8d97fda0691154f, entries=2, sequenceid=6, filesize=5.0 K 2023-07-11 22:00:01,000 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf/49d35bbb305d47ba9d17f612c4e63305, entries=48, sequenceid=6, filesize=8.1 K 2023-07-11 22:00:01,019 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d72903b5e5f56146bf7b082b4bee9919 in 290ms, sequenceid=6, compaction requested=false 2023-07-11 22:00:01,020 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d72903b5e5f56146bf7b082b4bee9919: 2023-07-11 22:00:01,021 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 22:00:01,021 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:00:01,021 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf/6d9821e4d33c42b2a8d97fda0691154f] hfiles 2023-07-11 22:00:01,021 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf/6d9821e4d33c42b2a8d97fda0691154f for snapshot=snaptb0-testConsecutiveExports 2023-07-11 22:00:01,022 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ec2f47f9d5936015fdf646328a8d88fb in 303ms, sequenceid=6, compaction requested=false 2023-07-11 22:00:01,022 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec2f47f9d5936015fdf646328a8d88fb: 2023-07-11 22:00:01,022 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 22:00:01,022 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:00:01,023 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf/49d35bbb305d47ba9d17f612c4e63305] hfiles 2023-07-11 22:00:01,023 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf/49d35bbb305d47ba9d17f612c4e63305 for snapshot=snaptb0-testConsecutiveExports 2023-07-11 22:00:01,064 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:00:01,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 22:00:01,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:00:01,066 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 22:00:01,203 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. completed. 2023-07-11 22:00:01,203 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 22:00:01,203 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:00:01,204 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:00:01,204 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,204 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 22:00:01,204 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:00:01,209 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,209 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 22:00:01,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:00:01,209 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:00:01,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:00:01,209 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 22:00:01,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:00:01,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:00:01,215 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. completed. 2023-07-11 22:00:01,215 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:00:01,215 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:00:01,216 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:00:01,216 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,216 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 22:00:01,216 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:00:01,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,217 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 22:00:01,218 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:00:01,218 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 22:00:01,220 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:00:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 22:00:01,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 22:00:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:00:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:00:01,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:00:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:00:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:00:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:00:01,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 22:00:01,229 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-11 22:00:01,229 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:00:01,229 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:00:01,229 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-11 22:00:01,229 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:00:01,240 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:00:01,240 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:00:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:00:01,240 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:00:01,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:00:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:00:01,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:00:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:00:01,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:00:01,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,244 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,245 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:00:01,245 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:00:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 22:00:01,251 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,251 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,251 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,251 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:00:01,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:00:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:00:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,253 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:00:01,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:00:01,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:00:01,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:00:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:00:01,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:00:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:00:01,259 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:00:01,259 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:00:01,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:00:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:00:01,260 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:00:01,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-11 22:00:01,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-11 22:00:01,258 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,265 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:00:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:00:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:00:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:00:01,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:00:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:00:01,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,566 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:00:01,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 22:00:01,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:00:01,568 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 22:00:01,574 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 22:00:01,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 22:00:01,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,789 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:01,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689112800453Consolidate snapshot: snaptb0-testConsecutiveExports at 1689112801260 (+807 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689112801260Writing data manifest for snaptb0-testConsecutiveExports at 1689112801341 (+81 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689112801446 (+105 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689112801788 (+342 ms) 2023-07-11 22:00:01,792 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 22:00:01,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.3300 sec 2023-07-11 22:00:02,568 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:00:02,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 22:00:02,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:00:02,573 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573 2023-07-11 22:00:02,573 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:00:02,635 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:00:02,635 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@33ee0059, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:02,635 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 22:00:02,663 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:02,769 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:02,770 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:02,770 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:02,771 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,680 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-5090678541411404051.jar 2023-07-11 22:00:04,681 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,682 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,786 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-7599772407193326543.jar 2023-07-11 22:00:04,786 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,787 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,788 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,789 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,790 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,792 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:04,793 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 22:00:04,793 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 22:00:04,794 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 22:00:04,795 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 22:00:04,795 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 22:00:04,796 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 22:00:04,797 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 22:00:04,797 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 22:00:04,798 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 22:00:04,810 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 22:00:04,811 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:04,812 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:04,813 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:00:04,813 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:04,813 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:04,814 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:00:04,815 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:00:08,404 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 22:00:08,438 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 22:00:08,468 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 22:00:08,815 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:00:08,817 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:00:08,935 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0003_000001 (auth:SIMPLE) 2023-07-11 22:00:22,373 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0003_000001 (auth:SIMPLE) 2023-07-11 22:00:25,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0003_000001 (auth:SIMPLE) 2023-07-11 22:00:39,274 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 22:00:39,274 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 22:00:39,279 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 22:00:39,279 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 22:00:39,280 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 22:00:39,280 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 22:00:39,281 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 22:00:39,281 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 22:00:39,281 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3b2afead in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 22:00:39,281 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 22:00:39,281 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 22:00:39,282 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:00:39,307 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:00:39,307 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@71643faf, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:39,307 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 22:00:39,318 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 22:00:39,365 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:39,365 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:39,366 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:39,367 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,577 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-451716558970537127.jar 2023-07-11 22:00:40,578 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,579 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,675 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-6389320592954432162.jar 2023-07-11 22:00:40,676 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,676 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,677 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,677 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,678 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,678 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 22:00:40,679 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 22:00:40,679 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 22:00:40,680 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 22:00:40,680 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 22:00:40,681 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 22:00:40,681 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 22:00:40,682 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 22:00:40,682 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 22:00:40,683 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 22:00:40,683 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 22:00:40,684 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:40,685 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:40,685 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:00:40,685 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:40,686 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:00:40,686 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:00:40,687 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:00:42,036 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 22:00:42,040 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 22:00:42,049 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 22:00:43,472 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:00:43,476 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:00:43,480 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0003_000001 (auth:SIMPLE) 2023-07-11 22:00:43,611 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0004_000001 (auth:SIMPLE) 2023-07-11 22:00:51,830 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0004_000001 (auth:SIMPLE) 2023-07-11 22:00:54,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0004_000001 (auth:SIMPLE) 2023-07-11 22:01:04,010 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0004_000001 (auth:SIMPLE) 2023-07-11 22:01:05,641 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 22:01:05,641 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 22:01:05,667 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 22:01:05,667 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 22:01:05,667 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 22:01:05,668 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 22:01:05,670 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 22:01:05,671 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 22:01:05,671 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3b2afead in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 22:01:05,671 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 22:01:05,671 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/local-export-1689112802573/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 22:01:05,696 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-11 22:01:05,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testConsecutiveExports 2023-07-11 22:01:05,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:05,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112865706"}]},"ts":"1689112865706"} 2023-07-11 22:01:05,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 22:01:05,712 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-11 22:01:05,714 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-11 22:01:05,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, UNASSIGN}] 2023-07-11 22:01:05,719 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, UNASSIGN 2023-07-11 22:01:05,722 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, UNASSIGN 2023-07-11 22:01:05,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ec2f47f9d5936015fdf646328a8d88fb, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:05,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d72903b5e5f56146bf7b082b4bee9919, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:05,723 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112865723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112865723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112865723"}]},"ts":"1689112865723"} 2023-07-11 22:01:05,723 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112865723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112865723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112865723"}]},"ts":"1689112865723"} 2023-07-11 22:01:05,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ec2f47f9d5936015fdf646328a8d88fb, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 22:01:05,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure d72903b5e5f56146bf7b082b4bee9919, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:05,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 22:01:05,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 22:01:05,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ec2f47f9d5936015fdf646328a8d88fb, disabling compactions & flushes 2023-07-11 22:01:05,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 22:01:05,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 22:01:05,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. after waiting 0 ms 2023-07-11 22:01:05,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 22:01:05,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close d72903b5e5f56146bf7b082b4bee9919 2023-07-11 22:01:05,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing d72903b5e5f56146bf7b082b4bee9919, disabling compactions & flushes 2023-07-11 22:01:05,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:01:05,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:01:05,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. after waiting 0 ms 2023-07-11 22:01:05,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:01:05,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:01:05,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:05,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919. 2023-07-11 22:01:05,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for d72903b5e5f56146bf7b082b4bee9919: 2023-07-11 22:01:05,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:01:05,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:05,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed d72903b5e5f56146bf7b082b4bee9919 2023-07-11 22:01:05,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb. 2023-07-11 22:01:05,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ec2f47f9d5936015fdf646328a8d88fb: 2023-07-11 22:01:05,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d72903b5e5f56146bf7b082b4bee9919, regionState=CLOSED 2023-07-11 22:01:05,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112865959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112865959"}]},"ts":"1689112865959"} 2023-07-11 22:01:05,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ec2f47f9d5936015fdf646328a8d88fb, regionState=CLOSED 2023-07-11 22:01:05,966 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689112865966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112865966"}]},"ts":"1689112865966"} 2023-07-11 22:01:05,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 22:01:05,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-11 22:01:05,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure d72903b5e5f56146bf7b082b4bee9919, server=jenkins-hbase5.apache.org,37459,1689112712887 in 238 msec 2023-07-11 22:01:05,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d72903b5e5f56146bf7b082b4bee9919, UNASSIGN in 259 msec 2023-07-11 22:01:05,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-11 22:01:05,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ec2f47f9d5936015fdf646328a8d88fb, server=jenkins-hbase5.apache.org,34709,1689112713115 in 248 msec 2023-07-11 22:01:05,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-11 22:01:05,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec2f47f9d5936015fdf646328a8d88fb, UNASSIGN in 264 msec 2023-07-11 22:01:05,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112865983"}]},"ts":"1689112865983"} 2023-07-11 22:01:05,987 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-11 22:01:05,990 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-11 22:01:05,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 293 msec 2023-07-11 22:01:06,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 22:01:06,011 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-11 22:01:06,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testConsecutiveExports 2023-07-11 22:01:06,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:06,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:06,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-11 22:01:06,020 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:06,021 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-11 22:01:06,026 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,026 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,027 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,026 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 22:01:06,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 22:01:06,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 22:01:06,028 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,028 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:06,028 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-11 22:01:06,028 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:06,028 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 22:01:06,029 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:06,028 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:06,029 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 22:01:06,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 22:01:06,030 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 2023-07-11 22:01:06,031 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 22:01:06,033 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/recovered.edits] 2023-07-11 22:01:06,037 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/recovered.edits] 2023-07-11 22:01:06,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf/6d9821e4d33c42b2a8d97fda0691154f to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/cf/6d9821e4d33c42b2a8d97fda0691154f 2023-07-11 22:01:06,051 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf/49d35bbb305d47ba9d17f612c4e63305 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/cf/49d35bbb305d47ba9d17f612c4e63305 2023-07-11 22:01:06,056 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919/recovered.edits/9.seqid 2023-07-11 22:01:06,057 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb/recovered.edits/9.seqid 2023-07-11 22:01:06,058 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/ec2f47f9d5936015fdf646328a8d88fb 2023-07-11 22:01:06,058 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testConsecutiveExports/d72903b5e5f56146bf7b082b4bee9919 2023-07-11 22:01:06,058 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 22:01:06,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:06,079 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-11 22:01:06,092 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-11 22:01:06,100 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:06,100 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-11 22:01:06,100 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112866100"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:06,100 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112866100"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:06,103 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 22:01:06,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d72903b5e5f56146bf7b082b4bee9919, NAME => 'testtb-testConsecutiveExports,,1689112796481.d72903b5e5f56146bf7b082b4bee9919.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ec2f47f9d5936015fdf646328a8d88fb, NAME => 'testtb-testConsecutiveExports,1,1689112796481.ec2f47f9d5936015fdf646328a8d88fb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 22:01:06,103 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-11 22:01:06,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112866103"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:06,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-11 22:01:06,109 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 22:01:06,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 96 msec 2023-07-11 22:01:06,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 22:01:06,132 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-11 22:01:06,158 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-11 22:01:06,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-11 22:01:06,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-11 22:01:06,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-11 22:01:06,217 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=745 (was 737) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:32995 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:41817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:44962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1675779593_1 at /127.0.0.1:38956 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:38964 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3192 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1675779593_1 at /127.0.0.1:44938 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:36820 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=889 (was 890), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1385 (was 1156) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 190), AvailableMemoryMB=1099 (was 2624) 2023-07-11 22:01:06,217 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-11 22:01:06,245 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=889, MaxFileDescriptor=60000, SystemLoadAverage=1385, ProcessCount=188, AvailableMemoryMB=1098 2023-07-11 22:01:06,245 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-11 22:01:06,247 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 22:01:06,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:06,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 22:01:06,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-11 22:01:06,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 22:01:06,271 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 22:01:06,275 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,276 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa empty. 2023-07-11 22:01:06,276 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,279 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,281 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 empty. 2023-07-11 22:01:06,281 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,281 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 22:01:06,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 22:01:06,435 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-11 22:01:06,453 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 09c86867b8171f45540f8d56d3e190aa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:06,457 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20b98cff183816de3720d072ce140810, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:06,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:06,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 09c86867b8171f45540f8d56d3e190aa, disabling compactions & flushes 2023-07-11 22:01:06,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. after waiting 0 ms 2023-07-11 22:01:06,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 09c86867b8171f45540f8d56d3e190aa: 2023-07-11 22:01:06,521 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:06,522 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 20b98cff183816de3720d072ce140810, disabling compactions & flushes 2023-07-11 22:01:06,522 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,522 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,522 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. after waiting 0 ms 2023-07-11 22:01:06,522 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,522 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,522 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 20b98cff183816de3720d072ce140810: 2023-07-11 22:01:06,525 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 22:01:06,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112866526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112866526"}]},"ts":"1689112866526"} 2023-07-11 22:01:06,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112866526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112866526"}]},"ts":"1689112866526"} 2023-07-11 22:01:06,541 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 22:01:06,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 22:01:06,543 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112866543"}]},"ts":"1689112866543"} 2023-07-11 22:01:06,546 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-11 22:01:06,551 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 22:01:06,552 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 22:01:06,552 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 22:01:06,552 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 22:01:06,552 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 22:01:06,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, ASSIGN}] 2023-07-11 22:01:06,556 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, ASSIGN 2023-07-11 22:01:06,560 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, ASSIGN 2023-07-11 22:01:06,563 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 22:01:06,563 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36649,1689112713270; forceNewPlan=false, retain=false 2023-07-11 22:01:06,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 22:01:06,713 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 22:01:06,717 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=20b98cff183816de3720d072ce140810, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:06,717 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=09c86867b8171f45540f8d56d3e190aa, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:06,717 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112866716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112866716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112866716"}]},"ts":"1689112866716"} 2023-07-11 22:01:06,717 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112866716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112866716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112866716"}]},"ts":"1689112866716"} 2023-07-11 22:01:06,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 20b98cff183816de3720d072ce140810, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:06,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 09c86867b8171f45540f8d56d3e190aa, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 22:01:06,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 22:01:06,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20b98cff183816de3720d072ce140810, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 22:01:06,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. service=AccessControlService 2023-07-11 22:01:06,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:06,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:06,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,914 INFO [StoreOpener-20b98cff183816de3720d072ce140810-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,919 DEBUG [StoreOpener-20b98cff183816de3720d072ce140810-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf 2023-07-11 22:01:06,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 09c86867b8171f45540f8d56d3e190aa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 22:01:06,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. service=AccessControlService 2023-07-11 22:01:06,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:06,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:06,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,921 DEBUG [StoreOpener-20b98cff183816de3720d072ce140810-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf 2023-07-11 22:01:06,924 INFO [StoreOpener-20b98cff183816de3720d072ce140810-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b98cff183816de3720d072ce140810 columnFamilyName cf 2023-07-11 22:01:06,925 INFO [StoreOpener-20b98cff183816de3720d072ce140810-1] regionserver.HStore(310): Store=20b98cff183816de3720d072ce140810/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:06,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,939 INFO [StoreOpener-09c86867b8171f45540f8d56d3e190aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,943 DEBUG [StoreOpener-09c86867b8171f45540f8d56d3e190aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf 2023-07-11 22:01:06,943 DEBUG [StoreOpener-09c86867b8171f45540f8d56d3e190aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf 2023-07-11 22:01:06,944 INFO [StoreOpener-09c86867b8171f45540f8d56d3e190aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09c86867b8171f45540f8d56d3e190aa columnFamilyName cf 2023-07-11 22:01:06,945 INFO [StoreOpener-09c86867b8171f45540f8d56d3e190aa-1] regionserver.HStore(310): Store=09c86867b8171f45540f8d56d3e190aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:06,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 20b98cff183816de3720d072ce140810 2023-07-11 22:01:06,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:06,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:06,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:06,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 20b98cff183816de3720d072ce140810; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60152595, jitterRate=-0.10365648567676544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:06,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 20b98cff183816de3720d072ce140810: 2023-07-11 22:01:06,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 09c86867b8171f45540f8d56d3e190aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70989938, jitterRate=0.0578325092792511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:06,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 09c86867b8171f45540f8d56d3e190aa: 2023-07-11 22:01:06,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810., pid=60, masterSystemTime=1689112866884 2023-07-11 22:01:06,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa., pid=61, masterSystemTime=1689112866887 2023-07-11 22:01:06,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:06,983 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=09c86867b8171f45540f8d56d3e190aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:06,984 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112866983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112866983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112866983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112866983"}]},"ts":"1689112866983"} 2023-07-11 22:01:06,985 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=20b98cff183816de3720d072ce140810, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:06,985 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112866985"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112866985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112866985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112866985"}]},"ts":"1689112866985"} 2023-07-11 22:01:06,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:06,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-11 22:01:06,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 09c86867b8171f45540f8d56d3e190aa, server=jenkins-hbase5.apache.org,36649,1689112713270 in 265 msec 2023-07-11 22:01:06,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-11 22:01:06,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 20b98cff183816de3720d072ce140810, server=jenkins-hbase5.apache.org,37459,1689112712887 in 268 msec 2023-07-11 22:01:06,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, ASSIGN in 439 msec 2023-07-11 22:01:06,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-11 22:01:06,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, ASSIGN in 441 msec 2023-07-11 22:01:06,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 22:01:06,999 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112866999"}]},"ts":"1689112866999"} 2023-07-11 22:01:07,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-11 22:01:07,002 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 22:01:07,003 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-11 22:01:07,005 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 22:01:07,007 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:07,007 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:07,007 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:07,007 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:07,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:07,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:07,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:07,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:07,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 759 msec 2023-07-11 22:01:07,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 22:01:07,382 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-11 22:01:07,382 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-11 22:01:07,382 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:07,396 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-11 22:01:07,396 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:07,396 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-11 22:01:07,401 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 22:01:07,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112867402 (current time:1689112867402). 2023-07-11 22:01:07,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:07,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x11a95dd0 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c4f19db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:07,441 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:07,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11a95dd0 to 127.0.0.1:58667 2023-07-11 22:01:07,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:07,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x2563b96a to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:07,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eff27cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:07,753 DEBUG [hconnection-0x2a2a780e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:07,757 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:07,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2563b96a to 127.0.0.1:58667 2023-07-11 22:01:07,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:07,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 22:01:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 22:01:07,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 22:01:07,772 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 22:01:07,773 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689113467773 2023-07-11 22:01:07,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:07,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 22:01:07,775 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:07,775 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:07,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 22:01:07,777 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 22:01:07,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-11 22:01:07,780 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 22:01:07,781 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689113467781 2023-07-11 22:01:07,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:07,791 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 22:01:07,791 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:07,793 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 22:01:07,793 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 22:01:07,875 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:07,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:07,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:07,877 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:07,889 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:07,889 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,027 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:08,027 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:08,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:08,027 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:08,028 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:08,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:08,029 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,029 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,029 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,029 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:08,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 22:01:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 22:01:08,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 22:01:08,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,038 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 22:01:08,038 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:08,038 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 22:01:08,038 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 22:01:08,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 22:01:08,042 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 22:01:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 22:01:08,042 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 22:01:08,043 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 22:01:08,043 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 22:01:08,077 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:08,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:08,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:08,078 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:08,158 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,158 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:08,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:08,259 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:08,259 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,259 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,259 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,260 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:08,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:08,260 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,260 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:08,260 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,260 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:08,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a619f0c[Count = 1] remaining members to acquire global barrier 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:08,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 22:01:08,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a619f0c[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:08,264 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 22:01:08,264 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,327 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,327 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,327 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,328 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,328 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 22:01:08,328 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 22:01:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,328 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:08,328 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:08,328 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 22:01:08,328 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,329 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:08,328 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:08,328 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 22:01:08,329 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. started... 2023-07-11 22:01:08,329 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:08,329 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:08,329 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. started... 2023-07-11 22:01:08,329 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:08,331 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:08,331 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20b98cff183816de3720d072ce140810: 2023-07-11 22:01:08,332 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,332 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:08,332 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 22:01:08,337 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09c86867b8171f45540f8d56d3e190aa: 2023-07-11 22:01:08,338 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,338 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:08,338 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 22:01:08,360 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. completed. 2023-07-11 22:01:08,360 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:08,361 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:08,361 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:08,361 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,361 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 22:01:08,361 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:08,363 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. completed. 2023-07-11 22:01:08,363 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:08,363 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:08,363 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:08,363 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,363 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 22:01:08,363 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:08,378 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:08,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:08,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:08,380 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 22:01:08,489 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 22:01:08,489 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:08,489 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 22:01:08,492 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:08,493 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 22:01:08,493 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:08,493 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 22:01:08,499 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 22:01:08,499 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:08,499 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 22:01:08,502 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:08,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 22:01:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:08,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,36649,1689112713270': 2023-07-11 22:01:08,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 22:01:08,518 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 22:01:08,519 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:08,519 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:08,519 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,519 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:08,522 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:08,523 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,523 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:08,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:08,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:08,524 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:08,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,526 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,526 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:08,537 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,537 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,538 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,543 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:08,545 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:08,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:08,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:08,545 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:08,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:08,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:08,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:08,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:08,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,546 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:08,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:08,880 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:08,882 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 22:01:09,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 22:01:09,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:09,011 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:09,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689112867773Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112868545 (+772 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112868545Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112868550 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689112868563 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689112869010 (+447 ms) 2023-07-11 22:01:09,013 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 22:01:09,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2390 sec 2023-07-11 22:01:09,882 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:09,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:09,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:09,904 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:09,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36649] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:01:09,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37459] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:01:09,916 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:09,917 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:09,917 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:09,938 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 22:01:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112869938 (current time:1689112869938). 2023-07-11 22:01:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x29ebb252 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:09,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@334c48c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:09,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:09,949 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:09,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ebb252 to 127.0.0.1:58667 2023-07-11 22:01:09,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:09,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x019a94a1 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:09,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7597dfe2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:09,977 DEBUG [hconnection-0x244c9bc3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:09,981 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:09,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x019a94a1 to 127.0.0.1:58667 2023-07-11 22:01:09,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:09,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 22:01:09,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:09,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 22:01:09,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 22:01:09,994 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 22:01:09,995 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689113469995 2023-07-11 22:01:09,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 22:01:09,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:09,997 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:09,997 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:10,000 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 22:01:10,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 22:01:10,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-11 22:01:10,003 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 22:01:10,004 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689113470004 2023-07-11 22:01:10,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,038 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 22:01:10,038 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:10,040 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 22:01:10,040 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 22:01:10,040 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,040 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,042 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:10,042 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:10,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:10,042 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:10,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:10,045 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:10,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,048 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,048 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,048 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,048 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,049 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 22:01:10,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,072 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 22:01:10,072 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:10,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,081 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 22:01:10,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,081 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:10,081 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 22:01:10,081 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:10,093 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 22:01:10,093 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 22:01:10,094 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 22:01:10,093 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 22:01:10,094 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 22:01:10,093 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 22:01:10,094 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 22:01:10,094 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 22:01:10,094 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 22:01:10,096 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,096 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:10,097 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,097 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,097 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:10,097 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,097 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:10,097 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:10,097 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,098 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:10,098 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,098 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:10,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:10,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,099 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:10,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 22:01:10,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1494ac54[Count = 1] remaining members to acquire global barrier 2023-07-11 22:01:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:10,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 22:01:10,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1494ac54[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:10,105 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 22:01:10,105 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,108 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,109 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 22:01:10,109 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 22:01:10,109 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:10,109 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,109 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,110 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:10,110 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 22:01:10,110 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:10,110 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 22:01:10,114 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,114 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,114 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 22:01:10,114 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 22:01:10,114 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:10,114 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:10,114 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:10,115 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:10,114 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:10,115 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:10,115 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. started... 2023-07-11 22:01:10,115 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 09c86867b8171f45540f8d56d3e190aa 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 22:01:10,115 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. started... 2023-07-11 22:01:10,117 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20b98cff183816de3720d072ce140810 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 22:01:10,231 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/.tmp/cf/d13c73f85b9d4ba0b538df46123cc46b 2023-07-11 22:01:10,248 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/.tmp/cf/d13c73f85b9d4ba0b538df46123cc46b as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf/d13c73f85b9d4ba0b538df46123cc46b 2023-07-11 22:01:10,257 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf/d13c73f85b9d4ba0b538df46123cc46b, entries=2, sequenceid=6, filesize=5.0 K 2023-07-11 22:01:10,258 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 09c86867b8171f45540f8d56d3e190aa in 143ms, sequenceid=6, compaction requested=false 2023-07-11 22:01:10,258 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-11 22:01:10,259 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09c86867b8171f45540f8d56d3e190aa: 2023-07-11 22:01:10,259 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,259 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:10,259 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf/d13c73f85b9d4ba0b538df46123cc46b] hfiles 2023-07-11 22:01:10,259 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf/d13c73f85b9d4ba0b538df46123cc46b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0004_000001 (auth:SIMPLE) 2023-07-11 22:01:10,286 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/.tmp/cf/bd519fe4a2374e2281c817f9791d6f27 2023-07-11 22:01:10,299 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:10,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:10,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:10,302 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:10,315 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/.tmp/cf/bd519fe4a2374e2281c817f9791d6f27 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf/bd519fe4a2374e2281c817f9791d6f27 2023-07-11 22:01:10,321 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf/bd519fe4a2374e2281c817f9791d6f27, entries=48, sequenceid=6, filesize=8.1 K 2023-07-11 22:01:10,322 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 20b98cff183816de3720d072ce140810 in 205ms, sequenceid=6, compaction requested=false 2023-07-11 22:01:10,334 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20b98cff183816de3720d072ce140810: 2023-07-11 22:01:10,334 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,334 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:10,334 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf/bd519fe4a2374e2281c817f9791d6f27] hfiles 2023-07-11 22:01:10,334 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf/bd519fe4a2374e2281c817f9791d6f27 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,450 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. completed. 2023-07-11 22:01:10,452 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:10,452 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:10,452 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:10,452 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,452 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 22:01:10,452 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:10,454 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:10,455 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 22:01:10,455 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:10,455 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 22:01:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,36649,1689112713270': 2023-07-11 22:01:10,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 22:01:10,533 WARN [DataStreamer for file /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion/region-manifest.20b98cff183816de3720d072ce140810] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 22:01:10,534 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. completed. 2023-07-11 22:01:10,534 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:10,534 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:10,534 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:10,534 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,534 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 22:01:10,534 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:10,539 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 22:01:10,539 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,540 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:10,540 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 22:01:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:10,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 22:01:10,548 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 22:01:10,548 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:10,548 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:10,548 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,548 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:10,562 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,563 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:10,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,562 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:10,563 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:10,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:10,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:10,564 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,564 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,567 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,567 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,568 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,571 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:10,571 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:10,571 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:10,571 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:10,571 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:10,571 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:10,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:10,572 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:10,572 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:10,572 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,574 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:10,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:10,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-11 22:01:10,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,602 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:10,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:10,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:10,604 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 22:01:10,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 22:01:10,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,815 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:10,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689112869995Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689112870574 (+579 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689112870574Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689112870586 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689112870694 (+108 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689112870813 (+119 ms) 2023-07-11 22:01:10,819 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 22:01:10,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 823 msec 2023-07-11 22:01:11,105 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 22:01:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:11,146 DEBUG [Listener at jenkins-hbase5.apache.org/41391] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 22:01:11,155 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 22:01:11,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34709] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 22:01:11,159 DEBUG [Listener at jenkins-hbase5.apache.org/41391] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 22:01:11,167 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 22:01:11,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36649] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 22:01:11,175 DEBUG [Listener at jenkins-hbase5.apache.org/41391] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 22:01:11,183 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:51598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 22:01:11,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37459] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 22:01:11,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 22:01:11,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:11,191 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 22:01:11,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-11 22:01:11,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 22:01:11,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 22:01:11,195 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,207 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 empty. 2023-07-11 22:01:11,207 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,208 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,208 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c empty. 2023-07-11 22:01:11,209 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,209 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 22:01:11,293 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-11 22:01:11,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 22:01:11,295 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => fd6620f3b81a3f47559adcb2eded8d67, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:11,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3ac22bf9c5238c219cc8d5270565af8c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:11,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:11,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing fd6620f3b81a3f47559adcb2eded8d67, disabling compactions & flushes 2023-07-11 22:01:11,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. after waiting 0 ms 2023-07-11 22:01:11,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for fd6620f3b81a3f47559adcb2eded8d67: 2023-07-11 22:01:11,368 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:11,370 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 3ac22bf9c5238c219cc8d5270565af8c, disabling compactions & flushes 2023-07-11 22:01:11,370 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,370 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,370 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. after waiting 0 ms 2023-07-11 22:01:11,370 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,370 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,370 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 3ac22bf9c5238c219cc8d5270565af8c: 2023-07-11 22:01:11,380 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 22:01:11,381 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112871381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112871381"}]},"ts":"1689112871381"} 2023-07-11 22:01:11,381 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112871381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112871381"}]},"ts":"1689112871381"} 2023-07-11 22:01:11,385 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 22:01:11,387 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 22:01:11,387 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112871387"}]},"ts":"1689112871387"} 2023-07-11 22:01:11,391 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-11 22:01:11,396 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 22:01:11,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 22:01:11,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 22:01:11,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 22:01:11,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 22:01:11,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, ASSIGN}] 2023-07-11 22:01:11,406 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, ASSIGN 2023-07-11 22:01:11,406 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, ASSIGN 2023-07-11 22:01:11,419 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 22:01:11,420 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,34709,1689112713115; forceNewPlan=false, retain=false 2023-07-11 22:01:11,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 22:01:11,551 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 22:01:11,570 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 22:01:11,573 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fd6620f3b81a3f47559adcb2eded8d67, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:11,573 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=3ac22bf9c5238c219cc8d5270565af8c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:11,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112871573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112871573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112871573"}]},"ts":"1689112871573"} 2023-07-11 22:01:11,574 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112871573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112871573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112871573"}]},"ts":"1689112871573"} 2023-07-11 22:01:11,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure fd6620f3b81a3f47559adcb2eded8d67, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:11,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 3ac22bf9c5238c219cc8d5270565af8c, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 22:01:11,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ac22bf9c5238c219cc8d5270565af8c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 22:01:11,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd6620f3b81a3f47559adcb2eded8d67, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.', STARTKEY => '', ENDKEY => '2'} 2023-07-11 22:01:11,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. service=AccessControlService 2023-07-11 22:01:11,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:11,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:11,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. service=AccessControlService 2023-07-11 22:01:11,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:11,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:11,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,772 INFO [StoreOpener-3ac22bf9c5238c219cc8d5270565af8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,777 DEBUG [StoreOpener-3ac22bf9c5238c219cc8d5270565af8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf 2023-07-11 22:01:11,778 DEBUG [StoreOpener-3ac22bf9c5238c219cc8d5270565af8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf 2023-07-11 22:01:11,779 INFO [StoreOpener-3ac22bf9c5238c219cc8d5270565af8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ac22bf9c5238c219cc8d5270565af8c columnFamilyName cf 2023-07-11 22:01:11,780 INFO [StoreOpener-3ac22bf9c5238c219cc8d5270565af8c-1] regionserver.HStore(310): Store=3ac22bf9c5238c219cc8d5270565af8c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:11,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 22:01:11,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:11,824 INFO [StoreOpener-fd6620f3b81a3f47559adcb2eded8d67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:11,837 DEBUG [StoreOpener-fd6620f3b81a3f47559adcb2eded8d67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf 2023-07-11 22:01:11,837 DEBUG [StoreOpener-fd6620f3b81a3f47559adcb2eded8d67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf 2023-07-11 22:01:11,837 INFO [StoreOpener-fd6620f3b81a3f47559adcb2eded8d67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd6620f3b81a3f47559adcb2eded8d67 columnFamilyName cf 2023-07-11 22:01:11,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 3ac22bf9c5238c219cc8d5270565af8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61289515, jitterRate=-0.08671505749225616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:11,838 INFO [StoreOpener-fd6620f3b81a3f47559adcb2eded8d67-1] regionserver.HStore(310): Store=fd6620f3b81a3f47559adcb2eded8d67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:11,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 3ac22bf9c5238c219cc8d5270565af8c: 2023-07-11 22:01:11,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c., pid=70, masterSystemTime=1689112871747 2023-07-11 22:01:11,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:11,848 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=3ac22bf9c5238c219cc8d5270565af8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:11,848 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112871848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112871848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112871848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112871848"}]},"ts":"1689112871848"} 2023-07-11 22:01:11,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:11,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-11 22:01:11,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 3ac22bf9c5238c219cc8d5270565af8c, server=jenkins-hbase5.apache.org,34709,1689112713115 in 273 msec 2023-07-11 22:01:11,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, ASSIGN in 455 msec 2023-07-11 22:01:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:11,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fd6620f3b81a3f47559adcb2eded8d67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59183251, jitterRate=-0.1181008368730545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:11,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fd6620f3b81a3f47559adcb2eded8d67: 2023-07-11 22:01:11,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67., pid=69, masterSystemTime=1689112871747 2023-07-11 22:01:11,869 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fd6620f3b81a3f47559adcb2eded8d67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:11,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112871869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112871869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112871869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112871869"}]},"ts":"1689112871869"} 2023-07-11 22:01:11,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:11,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-11 22:01:11,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure fd6620f3b81a3f47559adcb2eded8d67, server=jenkins-hbase5.apache.org,37459,1689112712887 in 296 msec 2023-07-11 22:01:11,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-11 22:01:11,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, ASSIGN in 476 msec 2023-07-11 22:01:11,885 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 22:01:11,886 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112871886"}]},"ts":"1689112871886"} 2023-07-11 22:01:11,890 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-11 22:01:11,893 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 22:01:11,894 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-11 22:01:11,897 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 22:01:11,899 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:11,899 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:11,899 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:11,899 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:11,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:11,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 715 msec 2023-07-11 22:01:12,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 22:01:12,309 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-11 22:01:12,330 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 22:01:12,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$2(1952): Client=jenkins//172.31.10.131 merge regions fd6620f3b81a3f47559adcb2eded8d67, 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:12,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fd6620f3b81a3f47559adcb2eded8d67, 3ac22bf9c5238c219cc8d5270565af8c], force=true 2023-07-11 22:01:12,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fd6620f3b81a3f47559adcb2eded8d67, 3ac22bf9c5238c219cc8d5270565af8c], force=true 2023-07-11 22:01:12,349 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fd6620f3b81a3f47559adcb2eded8d67, 3ac22bf9c5238c219cc8d5270565af8c], force=true 2023-07-11 22:01:12,349 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fd6620f3b81a3f47559adcb2eded8d67, 3ac22bf9c5238c219cc8d5270565af8c], force=true 2023-07-11 22:01:12,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 22:01:12,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, UNASSIGN}] 2023-07-11 22:01:12,380 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, UNASSIGN 2023-07-11 22:01:12,381 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, UNASSIGN 2023-07-11 22:01:12,386 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fd6620f3b81a3f47559adcb2eded8d67, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:12,386 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=3ac22bf9c5238c219cc8d5270565af8c, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:12,387 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112872386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112872386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112872386"}]},"ts":"1689112872386"} 2023-07-11 22:01:12,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112872386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112872386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112872386"}]},"ts":"1689112872386"} 2023-07-11 22:01:12,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure fd6620f3b81a3f47559adcb2eded8d67, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:12,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 3ac22bf9c5238c219cc8d5270565af8c, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 22:01:12,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 22:01:12,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:12,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fd6620f3b81a3f47559adcb2eded8d67, disabling compactions & flushes 2023-07-11 22:01:12,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:12,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:12,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. after waiting 0 ms 2023-07-11 22:01:12,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:12,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing fd6620f3b81a3f47559adcb2eded8d67 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 22:01:12,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:12,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 3ac22bf9c5238c219cc8d5270565af8c, disabling compactions & flushes 2023-07-11 22:01:12,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:12,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:12,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. after waiting 0 ms 2023-07-11 22:01:12,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:12,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 3ac22bf9c5238c219cc8d5270565af8c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 22:01:12,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/.tmp/cf/b5b993c471124ec49d4d57296ba961c4 2023-07-11 22:01:12,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/.tmp/cf/b676ca2abb99411d83e5ca57dd4293bd 2023-07-11 22:01:12,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/.tmp/cf/b5b993c471124ec49d4d57296ba961c4 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf/b5b993c471124ec49d4d57296ba961c4 2023-07-11 22:01:12,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf/b5b993c471124ec49d4d57296ba961c4, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 22:01:12,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fd6620f3b81a3f47559adcb2eded8d67 in 60ms, sequenceid=5, compaction requested=false 2023-07-11 22:01:12,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/.tmp/cf/b676ca2abb99411d83e5ca57dd4293bd as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf/b676ca2abb99411d83e5ca57dd4293bd 2023-07-11 22:01:12,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 22:01:12,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:12,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67. 2023-07-11 22:01:12,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fd6620f3b81a3f47559adcb2eded8d67: 2023-07-11 22:01:12,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:12,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fd6620f3b81a3f47559adcb2eded8d67, regionState=CLOSED 2023-07-11 22:01:12,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112872628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112872628"}]},"ts":"1689112872628"} 2023-07-11 22:01:12,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf/b676ca2abb99411d83e5ca57dd4293bd, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 22:01:12,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-11 22:01:12,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure fd6620f3b81a3f47559adcb2eded8d67, server=jenkins-hbase5.apache.org,37459,1689112712887 in 244 msec 2023-07-11 22:01:12,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 3ac22bf9c5238c219cc8d5270565af8c in 89ms, sequenceid=5, compaction requested=false 2023-07-11 22:01:12,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd6620f3b81a3f47559adcb2eded8d67, UNASSIGN in 261 msec 2023-07-11 22:01:12,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 22:01:12,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 22:01:12,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:12,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c. 2023-07-11 22:01:12,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 3ac22bf9c5238c219cc8d5270565af8c: 2023-07-11 22:01:12,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:12,675 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=3ac22bf9c5238c219cc8d5270565af8c, regionState=CLOSED 2023-07-11 22:01:12,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689112872675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112872675"}]},"ts":"1689112872675"} 2023-07-11 22:01:12,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-11 22:01:12,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 3ac22bf9c5238c219cc8d5270565af8c, server=jenkins-hbase5.apache.org,34709,1689112713115 in 287 msec 2023-07-11 22:01:12,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-11 22:01:12,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3ac22bf9c5238c219cc8d5270565af8c, UNASSIGN in 310 msec 2023-07-11 22:01:12,803 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 22:01:12,807 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871186.fd6620f3b81a3f47559adcb2eded8d67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:12,807 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689112871186.3ac22bf9c5238c219cc8d5270565af8c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:12,807 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:12,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, ASSIGN}] 2023-07-11 22:01:12,886 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, ASSIGN 2023-07-11 22:01:12,888 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, ASSIGN; state=MERGED, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 22:01:12,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 22:01:13,039 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 22:01:13,042 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6111a93dd69b5880b14d297ade1272e2, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,042 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112873042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112873042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112873042"}]},"ts":"1689112873042"} 2023-07-11 22:01:13,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 6111a93dd69b5880b14d297ade1272e2, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:13,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:13,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6111a93dd69b5880b14d297ade1272e2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.', STARTKEY => '', ENDKEY => ''} 2023-07-11 22:01:13,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. service=AccessControlService 2023-07-11 22:01:13,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:13,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:13,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/.regioninfo 2023-07-11 22:01:13,271 INFO [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,273 DEBUG [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf 2023-07-11 22:01:13,273 DEBUG [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf 2023-07-11 22:01:13,273 INFO [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6111a93dd69b5880b14d297ade1272e2 columnFamilyName cf 2023-07-11 22:01:13,347 DEBUG [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] regionserver.HStore(539): loaded hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b5b993c471124ec49d4d57296ba961c4.fd6620f3b81a3f47559adcb2eded8d67->hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf/b5b993c471124ec49d4d57296ba961c4-top 2023-07-11 22:01:13,372 DEBUG [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] regionserver.HStore(539): loaded hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b676ca2abb99411d83e5ca57dd4293bd.3ac22bf9c5238c219cc8d5270565af8c->hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf/b676ca2abb99411d83e5ca57dd4293bd-top 2023-07-11 22:01:13,372 INFO [StoreOpener-6111a93dd69b5880b14d297ade1272e2-1] regionserver.HStore(310): Store=6111a93dd69b5880b14d297ade1272e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:13,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:13,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6111a93dd69b5880b14d297ade1272e2; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62857907, jitterRate=-0.06334419548511505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:13,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6111a93dd69b5880b14d297ade1272e2: 2023-07-11 22:01:13,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2., pid=77, masterSystemTime=1689112873200 2023-07-11 22:01:13,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.,because compaction is disabled. 2023-07-11 22:01:13,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:13,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:13,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6111a93dd69b5880b14d297ade1272e2, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,394 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112873393"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112873393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112873393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112873393"}]},"ts":"1689112873393"} 2023-07-11 22:01:13,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 22:01:13,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 6111a93dd69b5880b14d297ade1272e2, server=jenkins-hbase5.apache.org,37459,1689112712887 in 349 msec 2023-07-11 22:01:13,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-11 22:01:13,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, ASSIGN in 518 msec 2023-07-11 22:01:13,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fd6620f3b81a3f47559adcb2eded8d67, 3ac22bf9c5238c219cc8d5270565af8c], force=true in 1.0750 sec 2023-07-11 22:01:13,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 22:01:13,461 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-11 22:01:13,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 22:01:13,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112873463 (current time:1689112873463). 2023-07-11 22:01:13,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:13,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x1895c276 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:13,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@537735c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:13,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:13,527 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:13,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1895c276 to 127.0.0.1:58667 2023-07-11 22:01:13,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:13,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x28bcf97e to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:13,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e0c186d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:13,591 DEBUG [hconnection-0x743fdf66-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:13,595 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:13,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28bcf97e to 127.0.0.1:58667 2023-07-11 22:01:13,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:13,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 22:01:13,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:13,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 22:01:13,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 22:01:13,618 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 22:01:13,619 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689113473619 2023-07-11 22:01:13,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 22:01:13,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,629 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:13,629 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:13,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 22:01:13,640 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 22:01:13,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 30 msec 2023-07-11 22:01:13,644 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 22:01:13,645 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689113473645 2023-07-11 22:01:13,729 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:13,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 22:01:13,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:13,731 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:13,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,776 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 22:01:13,777 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:13,777 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-11 22:01:13,777 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-11 22:01:13,777 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,777 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,811 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:13,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:13,811 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:13,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:13,811 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:13,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,812 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,813 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,813 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:13,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 22:01:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 22:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 22:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 22:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 22:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 22:01:13,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,832 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 22:01:13,832 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:13,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,867 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 22:01:13,849 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 22:01:13,868 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:13,867 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 22:01:13,869 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 22:01:13,870 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 22:01:13,870 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 22:01:13,868 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 22:01:13,870 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 22:01:13,870 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:13,871 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 22:01:13,871 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 22:01:13,871 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 22:01:13,904 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,933 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,933 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:13,933 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,934 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:13,933 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,934 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:13,934 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,935 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,935 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:13,935 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:13,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:13,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 22:01:13,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:13,936 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:13,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:13,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:13,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:13,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-11 22:01:13,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4209697f[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:13,946 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-11 22:01:13,946 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,987 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,990 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 22:01:13,990 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 22:01:13,990 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:13,988 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,988 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:13,990 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:13,987 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,990 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 22:01:13,991 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 22:01:13,991 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:13,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,994 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 22:01:13,995 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:13,995 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:13,995 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:13,996 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. started... 2023-07-11 22:01:13,998 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6111a93dd69b5880b14d297ade1272e2: 2023-07-11 22:01:13,998 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:13,998 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:13,999 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b5b993c471124ec49d4d57296ba961c4.fd6620f3b81a3f47559adcb2eded8d67->hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf/b5b993c471124ec49d4d57296ba961c4-top, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b676ca2abb99411d83e5ca57dd4293bd.3ac22bf9c5238c219cc8d5270565af8c->hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf/b676ca2abb99411d83e5ca57dd4293bd-top] hfiles 2023-07-11 22:01:13,999 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b5b993c471124ec49d4d57296ba961c4.fd6620f3b81a3f47559adcb2eded8d67 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,000 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b676ca2abb99411d83e5ca57dd4293bd.3ac22bf9c5238c219cc8d5270565af8c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,025 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 22:01:14,027 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:14,028 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 22:01:14,049 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 22:01:14,049 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:14,049 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 22:01:14,140 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. completed. 2023-07-11 22:01:14,140 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 22:01:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:14,236 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:14,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 22:01:14,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:14,238 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 22:01:14,247 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,247 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 22:01:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,247 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:14,247 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 22:01:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:14,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:14,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:14,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:14,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:14,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-11 22:01:14,260 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-11 22:01:14,260 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:14,260 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:14,260 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,260 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:14,287 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:14,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,287 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:14,287 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,288 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:14,288 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:14,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:14,290 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:14,291 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,294 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,295 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:14,295 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:14,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:14,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:14,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:14,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:14,345 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:14,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:14,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:14,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:14,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:14,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-11 22:01:14,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,571 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689112873619Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112874348 (+729 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112874348Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112874374 (+26 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689112874433 (+59 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689112874570 (+137 ms) 2023-07-11 22:01:14,574 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 22:01:14,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 950 msec 2023-07-11 22:01:14,738 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:14,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 22:01:14,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:14,742 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741 2023-07-11 22:01:14,742 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41803, tgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741, rawTgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:01:14,789 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:01:14,790 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-52766171_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,790 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-11 22:01:14,803 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:14,939 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:14,940 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:14,941 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:14,941 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,379 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-4764425863917830200.jar 2023-07-11 22:01:16,380 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,380 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,473 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-5610183271744600998.jar 2023-07-11 22:01:16,474 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,475 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,476 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,476 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,481 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,481 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:16,482 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 22:01:16,483 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 22:01:16,483 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 22:01:16,484 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 22:01:16,484 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 22:01:16,485 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 22:01:16,486 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 22:01:16,486 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 22:01:16,487 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 22:01:16,488 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 22:01:16,488 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:16,489 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:16,490 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:16,490 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:16,490 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:16,491 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:16,492 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:17,256 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 22:01:17,830 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 22:01:17,836 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-11 22:01:17,839 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-11 22:01:18,065 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:01:18,067 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:01:18,276 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0005_000001 (auth:SIMPLE) 2023-07-11 22:01:24,842 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0005_000001 (auth:SIMPLE) 2023-07-11 22:01:27,298 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0005_000001 (auth:SIMPLE) 2023-07-11 22:01:33,347 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 22:01:33,348 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 22:01:33,360 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,360 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 22:01:33,361 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 22:01:33,361 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,361 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 22:01:33,361 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 22:01:33,361 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,362 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 22:01:33,362 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112874741/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 22:01:33,369 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,370 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 22:01:33,377 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112893377"}]},"ts":"1689112893377"} 2023-07-11 22:01:33,379 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-11 22:01:33,381 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-11 22:01:33,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, UNASSIGN}] 2023-07-11 22:01:33,384 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, UNASSIGN 2023-07-11 22:01:33,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6111a93dd69b5880b14d297ade1272e2, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:33,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112893385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112893385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112893385"}]},"ts":"1689112893385"} 2023-07-11 22:01:33,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 6111a93dd69b5880b14d297ade1272e2, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:33,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 22:01:33,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:33,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6111a93dd69b5880b14d297ade1272e2, disabling compactions & flushes 2023-07-11 22:01:33,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:33,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:33,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. after waiting 0 ms 2023-07-11 22:01:33,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:33,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-11 22:01:33,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:33,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2. 2023-07-11 22:01:33,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6111a93dd69b5880b14d297ade1272e2: 2023-07-11 22:01:33,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:33,566 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6111a93dd69b5880b14d297ade1272e2, regionState=CLOSED 2023-07-11 22:01:33,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689112893566"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112893566"}]},"ts":"1689112893566"} 2023-07-11 22:01:33,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-11 22:01:33,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 6111a93dd69b5880b14d297ade1272e2, server=jenkins-hbase5.apache.org,37459,1689112712887 in 180 msec 2023-07-11 22:01:33,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-11 22:01:33,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6111a93dd69b5880b14d297ade1272e2, UNASSIGN in 189 msec 2023-07-11 22:01:33,573 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112893572"}]},"ts":"1689112893572"} 2023-07-11 22:01:33,574 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-11 22:01:33,576 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-11 22:01:33,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 207 msec 2023-07-11 22:01:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 22:01:33,680 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-11 22:01:33,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,688 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,692 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,697 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,697 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,697 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,697 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 22:01:33,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 22:01:33,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 22:01:33,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,699 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:33,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:33,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 22:01:33,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:33,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:33,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:33,703 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:33,704 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:33,706 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/recovered.edits] 2023-07-11 22:01:33,708 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:33,716 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/recovered.edits] 2023-07-11 22:01:33,718 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf/b676ca2abb99411d83e5ca57dd4293bd to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/cf/b676ca2abb99411d83e5ca57dd4293bd 2023-07-11 22:01:33,721 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/recovered.edits] 2023-07-11 22:01:33,722 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf/b5b993c471124ec49d4d57296ba961c4 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/cf/b5b993c471124ec49d4d57296ba961c4 2023-07-11 22:01:33,722 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/recovered.edits/8.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c/recovered.edits/8.seqid 2023-07-11 22:01:33,723 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:33,731 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b5b993c471124ec49d4d57296ba961c4.fd6620f3b81a3f47559adcb2eded8d67 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b5b993c471124ec49d4d57296ba961c4.fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:33,732 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/recovered.edits/8.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67/recovered.edits/8.seqid 2023-07-11 22:01:33,732 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd6620f3b81a3f47559adcb2eded8d67 2023-07-11 22:01:33,734 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b676ca2abb99411d83e5ca57dd4293bd.3ac22bf9c5238c219cc8d5270565af8c to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/cf/b676ca2abb99411d83e5ca57dd4293bd.3ac22bf9c5238c219cc8d5270565af8c 2023-07-11 22:01:33,738 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/recovered.edits/12.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2/recovered.edits/12.seqid 2023-07-11 22:01:33,738 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6111a93dd69b5880b14d297ade1272e2 2023-07-11 22:01:33,738 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 22:01:33,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,763 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-11 22:01:33,783 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-11 22:01:33,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-11 22:01:33,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112893785"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:33,799 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 22:01:33,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6111a93dd69b5880b14d297ade1272e2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689112871187.6111a93dd69b5880b14d297ade1272e2.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 22:01:33,799 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-11 22:01:33,800 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112893799"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:33,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 22:01:33,815 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-11 22:01:33,818 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:33,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 135 msec 2023-07-11 22:01:34,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 22:01:34,004 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-11 22:01:34,005 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 22:01:34,025 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112894025"}]},"ts":"1689112894025"} 2023-07-11 22:01:34,027 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-11 22:01:34,031 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-11 22:01:34,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, UNASSIGN}] 2023-07-11 22:01:34,033 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, UNASSIGN 2023-07-11 22:01:34,035 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, UNASSIGN 2023-07-11 22:01:34,036 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=09c86867b8171f45540f8d56d3e190aa, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:34,036 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=20b98cff183816de3720d072ce140810, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:34,036 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112894036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112894036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112894036"}]},"ts":"1689112894036"} 2023-07-11 22:01:34,036 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112894036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112894036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112894036"}]},"ts":"1689112894036"} 2023-07-11 22:01:34,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 09c86867b8171f45540f8d56d3e190aa, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 22:01:34,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 20b98cff183816de3720d072ce140810, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:34,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 22:01:34,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:34,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 09c86867b8171f45540f8d56d3e190aa, disabling compactions & flushes 2023-07-11 22:01:34,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:34,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:34,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. after waiting 0 ms 2023-07-11 22:01:34,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:34,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 20b98cff183816de3720d072ce140810 2023-07-11 22:01:34,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 20b98cff183816de3720d072ce140810, disabling compactions & flushes 2023-07-11 22:01:34,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:34,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:34,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. after waiting 0 ms 2023-07-11 22:01:34,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:34,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:01:34,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:34,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa. 2023-07-11 22:01:34,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 09c86867b8171f45540f8d56d3e190aa: 2023-07-11 22:01:34,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:01:34,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:34,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810. 2023-07-11 22:01:34,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 20b98cff183816de3720d072ce140810: 2023-07-11 22:01:34,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:34,239 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=09c86867b8171f45540f8d56d3e190aa, regionState=CLOSED 2023-07-11 22:01:34,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 20b98cff183816de3720d072ce140810 2023-07-11 22:01:34,239 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112894239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112894239"}]},"ts":"1689112894239"} 2023-07-11 22:01:34,240 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=20b98cff183816de3720d072ce140810, regionState=CLOSED 2023-07-11 22:01:34,240 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689112894240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112894240"}]},"ts":"1689112894240"} 2023-07-11 22:01:34,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-11 22:01:34,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 09c86867b8171f45540f8d56d3e190aa, server=jenkins-hbase5.apache.org,36649,1689112713270 in 203 msec 2023-07-11 22:01:34,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-11 22:01:34,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 20b98cff183816de3720d072ce140810, server=jenkins-hbase5.apache.org,37459,1689112712887 in 203 msec 2023-07-11 22:01:34,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09c86867b8171f45540f8d56d3e190aa, UNASSIGN in 214 msec 2023-07-11 22:01:34,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-11 22:01:34,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b98cff183816de3720d072ce140810, UNASSIGN in 215 msec 2023-07-11 22:01:34,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112894249"}]},"ts":"1689112894249"} 2023-07-11 22:01:34,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-11 22:01:34,254 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-11 22:01:34,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 249 msec 2023-07-11 22:01:34,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 22:01:34,328 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-11 22:01:34,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,343 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,344 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,345 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,353 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,353 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,354 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,354 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 22:01:34,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 22:01:34,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 22:01:34,355 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,355 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:34,355 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-11 22:01:34,357 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,357 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:34,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 22:01:34,359 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/recovered.edits] 2023-07-11 22:01:34,360 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/recovered.edits] 2023-07-11 22:01:34,370 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf/d13c73f85b9d4ba0b538df46123cc46b to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/cf/d13c73f85b9d4ba0b538df46123cc46b 2023-07-11 22:01:34,372 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf/bd519fe4a2374e2281c817f9791d6f27 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/cf/bd519fe4a2374e2281c817f9791d6f27 2023-07-11 22:01:34,379 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa/recovered.edits/9.seqid 2023-07-11 22:01:34,379 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810/recovered.edits/9.seqid 2023-07-11 22:01:34,380 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09c86867b8171f45540f8d56d3e190aa 2023-07-11 22:01:34,380 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b98cff183816de3720d072ce140810 2023-07-11 22:01:34,380 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 22:01:34,384 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,396 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-11 22:01:34,411 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-11 22:01:34,413 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,413 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-11 22:01:34,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112894413"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:34,414 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112894413"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:34,415 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 22:01:34,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 09c86867b8171f45540f8d56d3e190aa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689112866247.09c86867b8171f45540f8d56d3e190aa.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 20b98cff183816de3720d072ce140810, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689112866247.20b98cff183816de3720d072ce140810.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 22:01:34,415 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-11 22:01:34,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112894415"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:34,422 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-11 22:01:34,426 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 97 msec 2023-07-11 22:01:34,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 22:01:34,460 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-11 22:01:34,477 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 22:01:34,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 22:01:34,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 22:01:34,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-11 22:01:34,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 22:01:34,531 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 745) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:43116 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:49658 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:43394 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:35289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1921742934_1 at /127.0.0.1:43080 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4080 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RSProcedureDispatcher-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=895 (was 889) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1365 (was 1385), ProcessCount=184 (was 188), AvailableMemoryMB=1198 (was 1098) - AvailableMemoryMB LEAK? - 2023-07-11 22:01:34,531 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-11 22:01:34,564 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=1365, ProcessCount=184, AvailableMemoryMB=1196 2023-07-11 22:01:34,564 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-11 22:01:34,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 22:01:34,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:34,574 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 22:01:34,575 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-11 22:01:34,575 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 22:01:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 22:01:34,579 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:34,579 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:34,580 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 empty. 2023-07-11 22:01:34,580 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d empty. 2023-07-11 22:01:34,581 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:34,582 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:34,582 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 22:01:34,644 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 22:01:34,646 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c7e8806ec688f466d17d0dbe1f5fb0d6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:34,646 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c35643463ba844580654dfca71f8ec1d, NAME => 'testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:34,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 22:01:34,696 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:34,696 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c35643463ba844580654dfca71f8ec1d, disabling compactions & flushes 2023-07-11 22:01:34,697 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:34,697 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:34,697 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. after waiting 0 ms 2023-07-11 22:01:34,697 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:34,697 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:34,697 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c35643463ba844580654dfca71f8ec1d: 2023-07-11 22:01:34,700 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:34,700 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c7e8806ec688f466d17d0dbe1f5fb0d6, disabling compactions & flushes 2023-07-11 22:01:34,701 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:34,701 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:34,701 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. after waiting 0 ms 2023-07-11 22:01:34,701 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:34,701 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:34,701 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c7e8806ec688f466d17d0dbe1f5fb0d6: 2023-07-11 22:01:34,708 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 22:01:34,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112894709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112894709"}]},"ts":"1689112894709"} 2023-07-11 22:01:34,710 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112894709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112894709"}]},"ts":"1689112894709"} 2023-07-11 22:01:34,712 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 22:01:34,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 22:01:34,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112894713"}]},"ts":"1689112894713"} 2023-07-11 22:01:34,716 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 22:01:34,719 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 22:01:34,721 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 22:01:34,721 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 22:01:34,721 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 22:01:34,721 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 22:01:34,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, ASSIGN}] 2023-07-11 22:01:34,725 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, ASSIGN 2023-07-11 22:01:34,725 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, ASSIGN 2023-07-11 22:01:34,726 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 22:01:34,726 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,34709,1689112713115; forceNewPlan=false, retain=false 2023-07-11 22:01:34,876 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 22:01:34,879 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c35643463ba844580654dfca71f8ec1d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:34,880 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112894879"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112894879"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112894879"}]},"ts":"1689112894879"} 2023-07-11 22:01:34,880 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c7e8806ec688f466d17d0dbe1f5fb0d6, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:34,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 22:01:34,880 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112894880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112894880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112894880"}]},"ts":"1689112894880"} 2023-07-11 22:01:34,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure c35643463ba844580654dfca71f8ec1d, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:34,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c7e8806ec688f466d17d0dbe1f5fb0d6, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 22:01:35,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:35,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c35643463ba844580654dfca71f8ec1d, NAME => 'testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 22:01:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. service=AccessControlService 2023-07-11 22:01:35,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,051 INFO [StoreOpener-c35643463ba844580654dfca71f8ec1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:35,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7e8806ec688f466d17d0dbe1f5fb0d6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 22:01:35,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. service=AccessControlService 2023-07-11 22:01:35,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:35,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:35,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,071 DEBUG [StoreOpener-c35643463ba844580654dfca71f8ec1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf 2023-07-11 22:01:35,071 DEBUG [StoreOpener-c35643463ba844580654dfca71f8ec1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf 2023-07-11 22:01:35,071 INFO [StoreOpener-c35643463ba844580654dfca71f8ec1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c35643463ba844580654dfca71f8ec1d columnFamilyName cf 2023-07-11 22:01:35,074 INFO [StoreOpener-c35643463ba844580654dfca71f8ec1d-1] regionserver.HStore(310): Store=c35643463ba844580654dfca71f8ec1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:35,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:35,091 INFO [StoreOpener-c7e8806ec688f466d17d0dbe1f5fb0d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:35,101 DEBUG [StoreOpener-c7e8806ec688f466d17d0dbe1f5fb0d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf 2023-07-11 22:01:35,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c35643463ba844580654dfca71f8ec1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61188223, jitterRate=-0.08822442591190338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:35,101 DEBUG [StoreOpener-c7e8806ec688f466d17d0dbe1f5fb0d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf 2023-07-11 22:01:35,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c35643463ba844580654dfca71f8ec1d: 2023-07-11 22:01:35,101 INFO [StoreOpener-c7e8806ec688f466d17d0dbe1f5fb0d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7e8806ec688f466d17d0dbe1f5fb0d6 columnFamilyName cf 2023-07-11 22:01:35,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d., pid=93, masterSystemTime=1689112895039 2023-07-11 22:01:35,102 INFO [StoreOpener-c7e8806ec688f466d17d0dbe1f5fb0d6-1] regionserver.HStore(310): Store=c7e8806ec688f466d17d0dbe1f5fb0d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:35,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:35,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:35,105 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c35643463ba844580654dfca71f8ec1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,105 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112895105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112895105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112895105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112895105"}]},"ts":"1689112895105"} 2023-07-11 22:01:35,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:35,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-11 22:01:35,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure c35643463ba844580654dfca71f8ec1d, server=jenkins-hbase5.apache.org,37459,1689112712887 in 224 msec 2023-07-11 22:01:35,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, ASSIGN in 388 msec 2023-07-11 22:01:35,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:35,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c7e8806ec688f466d17d0dbe1f5fb0d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68764542, jitterRate=0.0246715247631073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:35,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c7e8806ec688f466d17d0dbe1f5fb0d6: 2023-07-11 22:01:35,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6., pid=94, masterSystemTime=1689112895040 2023-07-11 22:01:35,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:35,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:35,116 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c7e8806ec688f466d17d0dbe1f5fb0d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,116 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112895116"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112895116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112895116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112895116"}]},"ts":"1689112895116"} 2023-07-11 22:01:35,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-11 22:01:35,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c7e8806ec688f466d17d0dbe1f5fb0d6, server=jenkins-hbase5.apache.org,34709,1689112713115 in 233 msec 2023-07-11 22:01:35,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-11 22:01:35,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, ASSIGN in 398 msec 2023-07-11 22:01:35,123 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 22:01:35,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112895123"}]},"ts":"1689112895123"} 2023-07-11 22:01:35,125 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 22:01:35,127 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 22:01:35,127 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-11 22:01:35,129 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 22:01:35,132 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:35,132 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:35,132 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:35,132 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:35,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:35,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:35,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:35,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:35,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 567 msec 2023-07-11 22:01:35,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 22:01:35,183 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-11 22:01:35,183 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-11 22:01:35,184 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:35,203 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-11 22:01:35,204 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:35,204 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-11 22:01:35,215 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 22:01:35,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112895215 (current time:1689112895215). 2023-07-11 22:01:35,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:35,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x436d99da to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:35,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51b4f783, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:35,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:35,286 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:35,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x436d99da to 127.0.0.1:58667 2023-07-11 22:01:35,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:35,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x2e09c60e to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:35,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105295c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:35,394 DEBUG [hconnection-0x777bde10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:35,395 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:35,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e09c60e to 127.0.0.1:58667 2023-07-11 22:01:35,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:35,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 22:01:35,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:35,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 22:01:35,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 22:01:35,408 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 22:01:35,408 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689113495408 2023-07-11 22:01:35,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 22:01:35,409 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 22:01:35,412 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:35,413 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 22:01:35,413 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:35,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 22:01:35,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-11 22:01:35,427 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 22:01:35,428 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689113495428 2023-07-11 22:01:35,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,491 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-11 22:01:35,491 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:35,493 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 22:01:35,493 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 22:01:35,513 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:35,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 22:01:35,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:35,515 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:35,556 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,557 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,563 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:35,563 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:35,563 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:35,563 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:35,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:35,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:35,564 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,564 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,566 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,567 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 22:01:35,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,568 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 22:01:35,569 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:35,569 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 22:01:35,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,569 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 22:01:35,569 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:35,573 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 22:01:35,573 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 22:01:35,573 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 22:01:35,573 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 22:01:35,573 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 22:01:35,573 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 22:01:35,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,574 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 22:01:35,574 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:35,575 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 22:01:35,575 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 22:01:35,575 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 22:01:35,577 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,577 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,578 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:35,582 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,582 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:35,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 22:01:35,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39ea976c[Count = 1] remaining members to acquire global barrier 2023-07-11 22:01:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:35,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 22:01:35,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39ea976c[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:35,597 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 22:01:35,597 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,598 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,598 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,598 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,599 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,599 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 22:01:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,599 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 22:01:35,599 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 22:01:35,599 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 22:01:35,599 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:35,599 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,599 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:35,603 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:35,603 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:35,603 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 22:01:35,603 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. started... 2023-07-11 22:01:35,603 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:35,603 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:35,604 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 22:01:35,606 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c35643463ba844580654dfca71f8ec1d: 2023-07-11 22:01:35,606 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:35,606 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:35,606 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:35,606 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,607 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. started... 2023-07-11 22:01:35,607 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:35,607 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 22:01:35,609 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7e8806ec688f466d17d0dbe1f5fb0d6: 2023-07-11 22:01:35,609 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,609 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:35,609 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 22:01:35,635 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. completed. 2023-07-11 22:01:35,638 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:35,638 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:35,638 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:35,638 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,638 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 22:01:35,638 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:35,640 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 22:01:35,640 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,640 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:35,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,640 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 22:01:35,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:35,642 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. completed. 2023-07-11 22:01:35,642 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:35,642 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:35,642 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:35,642 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,642 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 22:01:35,642 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:35,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,644 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,644 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 22:01:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,644 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:35,644 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 22:01:35,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 22:01:35,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 22:01:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:35,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 22:01:35,656 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 22:01:35,656 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:35,656 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:35,656 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,656 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,658 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,659 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:35,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:35,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,660 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,660 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,663 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:35,663 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,664 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:35,672 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:35,672 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:35,673 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,675 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,673 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:35,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:35,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:35,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:35,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:35,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:35,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:35,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,715 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:35,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 22:01:35,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:35,718 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:35,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 22:01:35,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,792 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:35,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689112895409Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689112895675 (+266 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689112895675Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689112895680 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689112895700 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689112895792 (+92 ms) 2023-07-11 22:01:35,798 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 22:01:35,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 388 msec 2023-07-11 22:01:36,018 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:36,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 22:01:36,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:36,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37459] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:01:36,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34709] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:01:36,069 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 22:01:36,069 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:36,070 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:36,104 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 22:01:36,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112896104 (current time:1689112896104). 2023-07-11 22:01:36,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:36,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x7e0fdba9 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:36,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57ad1126, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:36,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:36,120 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:36,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e0fdba9 to 127.0.0.1:58667 2023-07-11 22:01:36,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:36,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x7b13edae to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:36,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b41a3f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:36,171 DEBUG [hconnection-0x44dab999-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:36,183 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:36,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b13edae to 127.0.0.1:58667 2023-07-11 22:01:36,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:36,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 22:01:36,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:36,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 22:01:36,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 22:01:36,196 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 22:01:36,197 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689113496197 2023-07-11 22:01:36,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 22:01:36,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 22:01:36,198 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:36,199 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:36,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 22:01:36,200 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 22:01:36,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-11 22:01:36,206 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 22:01:36,206 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689113496206 2023-07-11 22:01:36,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,271 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-11 22:01:36,271 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:36,273 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 22:01:36,273 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 22:01:36,299 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:36,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 22:01:36,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:36,302 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:36,303 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,303 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,305 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:36,305 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:36,305 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:36,305 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,306 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,306 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,307 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,307 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 22:01:36,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 22:01:36,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,308 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 22:01:36,308 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:36,308 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 22:01:36,308 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 22:01:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,309 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 22:01:36,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,310 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 22:01:36,310 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 22:01:36,319 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 22:01:36,321 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,321 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,321 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,321 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:36,322 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 22:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f35e6a2[Count = 1] remaining members to acquire global barrier 2023-07-11 22:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,331 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-11 22:01:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 22:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f35e6a2[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:36,334 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 22:01:36,334 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 22:01:36,342 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 22:01:36,342 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 22:01:36,342 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,342 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:36,342 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:36,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,342 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:36,342 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:36,342 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. started... 2023-07-11 22:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,343 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 22:01:36,342 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,343 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:36,343 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:36,343 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:36,343 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:36,343 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. started... 2023-07-11 22:01:36,345 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 22:01:36,345 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:36,345 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 22:01:36,347 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c7e8806ec688f466d17d0dbe1f5fb0d6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 22:01:36,347 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c35643463ba844580654dfca71f8ec1d 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 22:01:36,429 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/.tmp/cf/effefff095544bb7809efc1d02eda3dc 2023-07-11 22:01:36,438 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/.tmp/cf/e215512f8fa54e04b9a41d0cacfadbcd 2023-07-11 22:01:36,439 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/.tmp/cf/effefff095544bb7809efc1d02eda3dc as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf/effefff095544bb7809efc1d02eda3dc 2023-07-11 22:01:36,447 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/.tmp/cf/e215512f8fa54e04b9a41d0cacfadbcd as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf/e215512f8fa54e04b9a41d0cacfadbcd 2023-07-11 22:01:36,450 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf/effefff095544bb7809efc1d02eda3dc, entries=48, sequenceid=6, filesize=8.1 K 2023-07-11 22:01:36,452 INFO [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for c7e8806ec688f466d17d0dbe1f5fb0d6 in 109ms, sequenceid=6, compaction requested=false 2023-07-11 22:01:36,454 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7e8806ec688f466d17d0dbe1f5fb0d6: 2023-07-11 22:01:36,455 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,456 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:36,456 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf/effefff095544bb7809efc1d02eda3dc] hfiles 2023-07-11 22:01:36,456 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf/effefff095544bb7809efc1d02eda3dc for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,457 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf/e215512f8fa54e04b9a41d0cacfadbcd, entries=2, sequenceid=6, filesize=5.0 K 2023-07-11 22:01:36,458 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c35643463ba844580654dfca71f8ec1d in 111ms, sequenceid=6, compaction requested=false 2023-07-11 22:01:36,459 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c35643463ba844580654dfca71f8ec1d: 2023-07-11 22:01:36,459 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,459 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:36,459 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf/e215512f8fa54e04b9a41d0cacfadbcd] hfiles 2023-07-11 22:01:36,459 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf/e215512f8fa54e04b9a41d0cacfadbcd for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,502 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:36,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 22:01:36,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:36,510 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:36,513 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. completed. 2023-07-11 22:01:36,513 DEBUG [rs(jenkins-hbase5.apache.org,34709,1689112713115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:36,513 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:36,513 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:36,513 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,513 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 22:01:36,513 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:36,514 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. completed. 2023-07-11 22:01:36,515 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:36,515 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:36,515 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:36,515 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,515 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 22:01:36,515 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:36,518 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 22:01:36,518 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:36,518 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 22:01:36,519 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:36,520 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 22:01:36,524 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:36,524 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,524 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 22:01:36,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:36,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:36,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:36,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:36,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 22:01:36,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:36,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:36,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:36,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:36,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:36,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,34709,1689112713115': 2023-07-11 22:01:36,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 22:01:36,538 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 22:01:36,538 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:36,538 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:36,538 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,539 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:36,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:36,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:36,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:36,542 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,543 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:36,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:36,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:36,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:36,544 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,544 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:36,545 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:36,549 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,549 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,550 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,553 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,553 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:36,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:36,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:36,553 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,554 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:36,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:36,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:36,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:36,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:36,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:36,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:36,554 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:36,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:36,556 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:36,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:36,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:36,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:36,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:36,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:36,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:36,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,654 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 22:01:36,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,655 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689112896197Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689112896556 (+359 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689112896556Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689112896575 (+19 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689112896593 (+18 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689112896654 (+61 ms) 2023-07-11 22:01:36,658 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 22:01:36,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 460 msec 2023-07-11 22:01:36,810 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:36,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 22:01:36,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:36,812 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812 2023-07-11 22:01:36,812 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41803, tgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812, rawTgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:01:36,835 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:01:36,835 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_164508386_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,835 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-11 22:01:36,840 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:36,898 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:36,899 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:36,899 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:36,900 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:37,923 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-5827569251509433952.jar 2023-07-11 22:01:37,923 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:37,924 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,015 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-3766387258007749314.jar 2023-07-11 22:01:38,016 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,016 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,017 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,018 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,018 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,019 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:38,019 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 22:01:38,020 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 22:01:38,020 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 22:01:38,021 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 22:01:38,021 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 22:01:38,022 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 22:01:38,023 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 22:01:38,023 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 22:01:38,024 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 22:01:38,024 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 22:01:38,025 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:38,025 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:38,026 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:38,026 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:38,027 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:38,027 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:38,028 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:38,424 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0005_000001 (auth:SIMPLE) 2023-07-11 22:01:38,938 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 22:01:38,941 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-11 22:01:39,123 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:01:39,123 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:01:39,160 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 22:01:39,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0006_000001 (auth:SIMPLE) 2023-07-11 22:01:45,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0006_000001 (auth:SIMPLE) 2023-07-11 22:01:47,441 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 22:01:47,442 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 22:01:47,475 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:47,475 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 22:01:47,476 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 22:01:47,476 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:47,482 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 22:01:47,482 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 22:01:47,482 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:47,485 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 22:01:47,485 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112896812/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 22:01:47,504 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,510 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112907510"}]},"ts":"1689112907510"} 2023-07-11 22:01:47,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 22:01:47,512 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 22:01:47,518 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-11 22:01:47,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, UNASSIGN}] 2023-07-11 22:01:47,522 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, UNASSIGN 2023-07-11 22:01:47,522 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, UNASSIGN 2023-07-11 22:01:47,523 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c35643463ba844580654dfca71f8ec1d, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:47,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112907523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112907523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112907523"}]},"ts":"1689112907523"} 2023-07-11 22:01:47,524 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c7e8806ec688f466d17d0dbe1f5fb0d6, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:47,524 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112907524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112907524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112907524"}]},"ts":"1689112907524"} 2023-07-11 22:01:47,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure c35643463ba844580654dfca71f8ec1d, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:47,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c7e8806ec688f466d17d0dbe1f5fb0d6, server=jenkins-hbase5.apache.org,34709,1689112713115}] 2023-07-11 22:01:47,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 22:01:47,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:47,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c35643463ba844580654dfca71f8ec1d, disabling compactions & flushes 2023-07-11 22:01:47,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:47,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:47,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. after waiting 0 ms 2023-07-11 22:01:47,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:47,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:47,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c7e8806ec688f466d17d0dbe1f5fb0d6, disabling compactions & flushes 2023-07-11 22:01:47,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:47,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:47,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. after waiting 0 ms 2023-07-11 22:01:47,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:47,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:01:47,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:01:47,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:47,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:01:47,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6. 2023-07-11 22:01:47,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d. 2023-07-11 22:01:47,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c7e8806ec688f466d17d0dbe1f5fb0d6: 2023-07-11 22:01:47,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c35643463ba844580654dfca71f8ec1d: 2023-07-11 22:01:47,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:47,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c35643463ba844580654dfca71f8ec1d, regionState=CLOSED 2023-07-11 22:01:47,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:47,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112907735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112907735"}]},"ts":"1689112907735"} 2023-07-11 22:01:47,736 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c7e8806ec688f466d17d0dbe1f5fb0d6, regionState=CLOSED 2023-07-11 22:01:47,736 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689112907736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112907736"}]},"ts":"1689112907736"} 2023-07-11 22:01:47,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-11 22:01:47,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure c35643463ba844580654dfca71f8ec1d, server=jenkins-hbase5.apache.org,37459,1689112712887 in 211 msec 2023-07-11 22:01:47,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-11 22:01:47,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c35643463ba844580654dfca71f8ec1d, UNASSIGN in 220 msec 2023-07-11 22:01:47,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c7e8806ec688f466d17d0dbe1f5fb0d6, server=jenkins-hbase5.apache.org,34709,1689112713115 in 212 msec 2023-07-11 22:01:47,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-11 22:01:47,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7e8806ec688f466d17d0dbe1f5fb0d6, UNASSIGN in 221 msec 2023-07-11 22:01:47,746 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112907746"}]},"ts":"1689112907746"} 2023-07-11 22:01:47,748 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 22:01:47,750 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-11 22:01:47,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 246 msec 2023-07-11 22:01:47,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 22:01:47,820 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-11 22:01:47,821 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,827 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,829 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,835 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 22:01:47,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 22:01:47,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 22:01:47,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:47,837 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:47,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 22:01:47,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:47,848 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:47,853 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/recovered.edits] 2023-07-11 22:01:47,858 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/recovered.edits] 2023-07-11 22:01:47,866 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf/effefff095544bb7809efc1d02eda3dc to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/cf/effefff095544bb7809efc1d02eda3dc 2023-07-11 22:01:47,868 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf/e215512f8fa54e04b9a41d0cacfadbcd to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/cf/e215512f8fa54e04b9a41d0cacfadbcd 2023-07-11 22:01:47,885 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6/recovered.edits/9.seqid 2023-07-11 22:01:47,886 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7e8806ec688f466d17d0dbe1f5fb0d6 2023-07-11 22:01:47,888 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d/recovered.edits/9.seqid 2023-07-11 22:01:47,889 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testEmptyExportFileSystemState/c35643463ba844580654dfca71f8ec1d 2023-07-11 22:01:47,889 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 22:01:47,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,901 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-11 22:01:47,910 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-11 22:01:47,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-11 22:01:47,911 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112907911"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:47,911 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112907911"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:47,917 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 22:01:47,917 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c35643463ba844580654dfca71f8ec1d, NAME => 'testtb-testEmptyExportFileSystemState,,1689112894566.c35643463ba844580654dfca71f8ec1d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c7e8806ec688f466d17d0dbe1f5fb0d6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689112894566.c7e8806ec688f466d17d0dbe1f5fb0d6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 22:01:47,917 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-11 22:01:47,917 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112907917"}]},"ts":"9223372036854775807"} 2023-07-11 22:01:47,929 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-11 22:01:47,931 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 22:01:47,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 110 msec 2023-07-11 22:01:47,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 22:01:47,940 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-11 22:01:47,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-11 22:01:47,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:47,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-11 22:01:47,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-11 22:01:48,033 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=769 (was 759) Potentially hanging thread: MoveIntermediateToDone Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:41391 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:38685 from appattempt_1689112732077_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:43117 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (504222127) connection to jenkins-hbase5.apache.org/172.31.10.131:38685 from appattempt_1689112732077_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MoveIntermediateToDone Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1314591801_1 at /127.0.0.1:41258 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:45312 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-553911272_17 at /127.0.0.1:51756 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:51762 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7aadf1de-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1485843396_17 at /127.0.0.1:53996 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4734 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=924 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1186 (was 1365), ProcessCount=181 (was 184), AvailableMemoryMB=2014 (was 1196) - AvailableMemoryMB LEAK? - 2023-07-11 22:01:48,033 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-11 22:01:48,068 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=769, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=1186, ProcessCount=181, AvailableMemoryMB=2013 2023-07-11 22:01:48,068 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-11 22:01:48,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 22:01:48,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,076 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 22:01:48,077 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 22:01:48,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-11 22:01:48,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 22:01:48,084 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,084 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,085 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 empty. 2023-07-11 22:01:48,085 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c empty. 2023-07-11 22:01:48,086 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,086 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,086 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 22:01:48,163 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-11 22:01:48,172 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6cc72c336e19f98e5877c5855d5e076c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:48,178 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 92e170d65fc47dd0cad8c440cee56fe2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp 2023-07-11 22:01:48,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 22:01:48,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:48,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6cc72c336e19f98e5877c5855d5e076c, disabling compactions & flushes 2023-07-11 22:01:48,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. after waiting 0 ms 2023-07-11 22:01:48,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6cc72c336e19f98e5877c5855d5e076c: 2023-07-11 22:01:48,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:48,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 92e170d65fc47dd0cad8c440cee56fe2, disabling compactions & flushes 2023-07-11 22:01:48,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,222 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. after waiting 0 ms 2023-07-11 22:01:48,222 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,222 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,222 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 92e170d65fc47dd0cad8c440cee56fe2: 2023-07-11 22:01:48,224 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 22:01:48,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112908225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112908225"}]},"ts":"1689112908225"} 2023-07-11 22:01:48,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112908225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112908225"}]},"ts":"1689112908225"} 2023-07-11 22:01:48,227 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 22:01:48,228 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 22:01:48,229 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112908228"}]},"ts":"1689112908228"} 2023-07-11 22:01:48,230 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-11 22:01:48,232 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-11 22:01:48,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 22:01:48,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 22:01:48,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 22:01:48,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 22:01:48,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, ASSIGN}] 2023-07-11 22:01:48,239 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, ASSIGN 2023-07-11 22:01:48,239 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, ASSIGN 2023-07-11 22:01:48,240 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,37459,1689112712887; forceNewPlan=false, retain=false 2023-07-11 22:01:48,240 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36649,1689112713270; forceNewPlan=false, retain=false 2023-07-11 22:01:48,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 22:01:48,390 INFO [jenkins-hbase5:33801] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 22:01:48,394 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=92e170d65fc47dd0cad8c440cee56fe2, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:48,394 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6cc72c336e19f98e5877c5855d5e076c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:48,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112908394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112908394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112908394"}]},"ts":"1689112908394"} 2023-07-11 22:01:48,394 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112908394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112908394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112908394"}]},"ts":"1689112908394"} 2023-07-11 22:01:48,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 92e170d65fc47dd0cad8c440cee56fe2, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:01:48,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 6cc72c336e19f98e5877c5855d5e076c, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 22:01:48,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92e170d65fc47dd0cad8c440cee56fe2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 22:01:48,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6cc72c336e19f98e5877c5855d5e076c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. service=AccessControlService 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. service=AccessControlService 2023-07-11 22:01:48,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:48,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 22:01:48,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,568 INFO [StoreOpener-92e170d65fc47dd0cad8c440cee56fe2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,570 DEBUG [StoreOpener-92e170d65fc47dd0cad8c440cee56fe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf 2023-07-11 22:01:48,570 DEBUG [StoreOpener-92e170d65fc47dd0cad8c440cee56fe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf 2023-07-11 22:01:48,571 INFO [StoreOpener-92e170d65fc47dd0cad8c440cee56fe2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92e170d65fc47dd0cad8c440cee56fe2 columnFamilyName cf 2023-07-11 22:01:48,571 INFO [StoreOpener-92e170d65fc47dd0cad8c440cee56fe2-1] regionserver.HStore(310): Store=92e170d65fc47dd0cad8c440cee56fe2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:48,576 INFO [StoreOpener-6cc72c336e19f98e5877c5855d5e076c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,578 DEBUG [StoreOpener-6cc72c336e19f98e5877c5855d5e076c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf 2023-07-11 22:01:48,578 DEBUG [StoreOpener-6cc72c336e19f98e5877c5855d5e076c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf 2023-07-11 22:01:48,579 INFO [StoreOpener-6cc72c336e19f98e5877c5855d5e076c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cc72c336e19f98e5877c5855d5e076c columnFamilyName cf 2023-07-11 22:01:48,585 INFO [StoreOpener-6cc72c336e19f98e5877c5855d5e076c-1] regionserver.HStore(310): Store=6cc72c336e19f98e5877c5855d5e076c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 22:01:48,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:01:48,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:48,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 92e170d65fc47dd0cad8c440cee56fe2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69305718, jitterRate=0.032735675573349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:48,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 92e170d65fc47dd0cad8c440cee56fe2: 2023-07-11 22:01:48,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2., pid=108, masterSystemTime=1689112908552 2023-07-11 22:01:48,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:48,593 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=92e170d65fc47dd0cad8c440cee56fe2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:48,594 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112908593"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112908593"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112908593"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112908593"}]},"ts":"1689112908593"} 2023-07-11 22:01:48,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-11 22:01:48,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 92e170d65fc47dd0cad8c440cee56fe2, server=jenkins-hbase5.apache.org,37459,1689112712887 in 204 msec 2023-07-11 22:01:48,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, ASSIGN in 368 msec 2023-07-11 22:01:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:01:48,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 22:01:48,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6cc72c336e19f98e5877c5855d5e076c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74238248, jitterRate=0.10623610019683838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 22:01:48,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6cc72c336e19f98e5877c5855d5e076c: 2023-07-11 22:01:48,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c., pid=109, masterSystemTime=1689112908555 2023-07-11 22:01:48,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:48,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6cc72c336e19f98e5877c5855d5e076c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:48,615 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112908614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689112908614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689112908614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689112908614"}]},"ts":"1689112908614"} 2023-07-11 22:01:48,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-11 22:01:48,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 6cc72c336e19f98e5877c5855d5e076c, server=jenkins-hbase5.apache.org,36649,1689112713270 in 219 msec 2023-07-11 22:01:48,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-11 22:01:48,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, ASSIGN in 386 msec 2023-07-11 22:01:48,624 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 22:01:48,624 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112908624"}]},"ts":"1689112908624"} 2023-07-11 22:01:48,625 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-11 22:01:48,627 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 22:01:48,628 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-11 22:01:48,629 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 22:01:48,631 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:48,631 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:48,631 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:48,631 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:01:48,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:48,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:48,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:48,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 563 msec 2023-07-11 22:01:48,637 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 22:01:48,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 22:01:48,682 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-11 22:01:48,683 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-11 22:01:48,683 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:48,687 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-11 22:01:48,687 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:48,687 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-11 22:01:48,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 22:01:48,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112908690 (current time:1689112908690). 2023-07-11 22:01:48,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:48,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x471fdcd4 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:48,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43c9d341, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:48,751 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:36010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:48,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x471fdcd4 to 127.0.0.1:58667 2023-07-11 22:01:48,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:48,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x12ae6119 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:48,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2beef6e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:48,875 DEBUG [hconnection-0x26b07b03-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:48,880 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:36022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:48,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12ae6119 to 127.0.0.1:58667 2023-07-11 22:01:48,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:48,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 22:01:48,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:48,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 22:01:48,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 22:01:48,894 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 22:01:48,895 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689113508895 2023-07-11 22:01:48,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 22:01:48,895 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:48,897 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:48,898 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 22:01:48,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 22:01:48,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-11 22:01:48,901 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 22:01:48,908 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689113508908 2023-07-11 22:01:48,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,983 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 22:01:48,983 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:48,985 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 22:01:48,985 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 22:01:48,992 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,992 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,994 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:48,994 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:48,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:48,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:48,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:48,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:48,994 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:48,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:48,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:48,995 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,996 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:48,996 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 22:01:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 22:01:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,997 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 22:01:48,997 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 22:01:48,998 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:48,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:48,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 22:01:48,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:48,999 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:49,001 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 22:01:49,001 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 22:01:49,001 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 22:01:49,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,001 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 22:01:49,001 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:49,008 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 22:01:49,008 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 22:01:49,008 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 22:01:49,008 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 22:01:49,008 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:49,010 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 22:01:49,010 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 22:01:49,010 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 22:01:49,010 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,010 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:49,016 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:49,017 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,017 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,017 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 22:01:49,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ef2031c[Count = 1] remaining members to acquire global barrier 2023-07-11 22:01:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 22:01:49,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ef2031c[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:49,022 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 22:01:49,023 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,024 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 22:01:49,024 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 22:01:49,024 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 22:01:49,024 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:49,027 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 22:01:49,027 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,027 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 22:01:49,027 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,029 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:49,029 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:49,029 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:49,029 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. started... 2023-07-11 22:01:49,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,029 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 22:01:49,029 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:49,030 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6cc72c336e19f98e5877c5855d5e076c: 2023-07-11 22:01:49,029 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,030 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:49,031 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,030 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:49,031 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:49,031 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. started... 2023-07-11 22:01:49,031 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 22:01:49,031 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,031 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:49,032 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92e170d65fc47dd0cad8c440cee56fe2: 2023-07-11 22:01:49,033 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,033 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:49,033 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 22:01:49,071 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. completed. 2023-07-11 22:01:49,071 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:49,071 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:49,071 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:49,071 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,071 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 22:01:49,071 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:49,073 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,073 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 22:01:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,073 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,073 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 22:01:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,086 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. completed. 2023-07-11 22:01:49,086 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:49,087 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:49,087 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:49,087 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,087 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 22:01:49,087 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,088 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 22:01:49,089 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,089 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 22:01:49,089 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,36649,1689112713270': 2023-07-11 22:01:49,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 22:01:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:49,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 22:01:49,098 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 22:01:49,098 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:49,098 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:49,098 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,098 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,101 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,102 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,103 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,105 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,105 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,106 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,117 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,117 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,117 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,117 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,118 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,118 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,119 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,119 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,119 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,119 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,119 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,119 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,121 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,121 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,121 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,121 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,122 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,122 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,199 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:49,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 22:01:49,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:49,201 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:49,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 22:01:49,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,241 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689112908895Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112909122 (+227 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112909122Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112909151 (+29 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689112909195 (+44 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689112909240 (+45 ms) 2023-07-11 22:01:49,244 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 22:01:49,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 347 msec 2023-07-11 22:01:49,501 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:49,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 22:01:49,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:49,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37459] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:01:49,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36649] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 22:01:49,532 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,532 DEBUG [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:49,532 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 22:01:49,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 22:01:49,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689112909554 (current time:1689112909554). 2023-07-11 22:01:49,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 22:01:49,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x54702663 to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:49,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71bd378d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:49,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:49,580 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:36036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:49,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54702663 to 127.0.0.1:58667 2023-07-11 22:01:49,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:49,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(139): Connect 0x2837c92a to 127.0.0.1:58667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 22:01:49,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d21a171, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 22:01:49,612 DEBUG [hconnection-0x65b8e007-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 22:01:49,613 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:36052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 22:01:49,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2837c92a to 127.0.0.1:58667 2023-07-11 22:01:49,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:01:49,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 22:01:49,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 22:01:49,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 22:01:49,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 22:01:49,627 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 22:01:49,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 22:01:49,629 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 22:01:49,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 22:01:49,629 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 22:01:49,629 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 22:01:49,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-11 22:01:49,632 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 22:01:49,633 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689113509633 2023-07-11 22:01:49,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,658 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 22:01:49,658 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:49,661 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 22:01:49,661 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 22:01:49,661 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,661 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,663 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,663 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,663 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,663 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,664 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,664 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 22:01:49,665 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,665 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 22:01:49,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 22:01:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 22:01:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 22:01:49,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,671 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 22:01:49,671 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:49,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,673 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 22:01:49,673 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 22:01:49,673 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:49,671 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 22:01:49,673 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 22:01:49,675 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 22:01:49,675 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 22:01:49,675 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,34709,1689112713115' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 22:01:49,675 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 22:01:49,673 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 22:01:49,676 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 22:01:49,676 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 22:01:49,676 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 22:01:49,684 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,684 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,684 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,684 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,684 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,685 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:49,685 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,685 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,686 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,686 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,686 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 22:01:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36649,1689112713270' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47b9c92c[Count = 1] remaining members to acquire global barrier 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,37459,1689112712887' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 22:01:49,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47b9c92c[Count = 0] remaining members to acquire global barrier 2023-07-11 22:01:49,690 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 22:01:49,690 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,694 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,694 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,694 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 22:01:49,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 22:01:49,695 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,34709,1689112713115' in zk 2023-07-11 22:01:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:49,695 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 22:01:49,695 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:49,695 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,695 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. started... 2023-07-11 22:01:49,695 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 22:01:49,696 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6cc72c336e19f98e5877c5855d5e076c 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-11 22:01:49,696 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 22:01:49,696 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 22:01:49,696 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:49,696 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. started... 2023-07-11 22:01:49,697 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 92e170d65fc47dd0cad8c440cee56fe2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-11 22:01:49,697 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 22:01:49,697 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,697 DEBUG [member: 'jenkins-hbase5.apache.org,34709,1689112713115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 22:01:49,719 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/.tmp/cf/c84a5734f52a456ab84058bd29d4a1fb 2023-07-11 22:01:49,730 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:49,730 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/.tmp/cf/a7a07485189f42bd909bda2f9a3189a3 2023-07-11 22:01:49,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 22:01:49,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:49,732 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 22:01:49,736 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/.tmp/cf/c84a5734f52a456ab84058bd29d4a1fb as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf/c84a5734f52a456ab84058bd29d4a1fb 2023-07-11 22:01:49,743 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/.tmp/cf/a7a07485189f42bd909bda2f9a3189a3 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf/a7a07485189f42bd909bda2f9a3189a3 2023-07-11 22:01:49,752 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf/c84a5734f52a456ab84058bd29d4a1fb, entries=46, sequenceid=6, filesize=7.9 K 2023-07-11 22:01:49,753 INFO [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 92e170d65fc47dd0cad8c440cee56fe2 in 56ms, sequenceid=6, compaction requested=false 2023-07-11 22:01:49,753 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-11 22:01:49,754 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92e170d65fc47dd0cad8c440cee56fe2: 2023-07-11 22:01:49,754 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,754 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:49,754 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf/c84a5734f52a456ab84058bd29d4a1fb] hfiles 2023-07-11 22:01:49,754 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf/c84a5734f52a456ab84058bd29d4a1fb for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,756 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf/a7a07485189f42bd909bda2f9a3189a3, entries=4, sequenceid=6, filesize=5.1 K 2023-07-11 22:01:49,760 INFO [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6cc72c336e19f98e5877c5855d5e076c in 64ms, sequenceid=6, compaction requested=false 2023-07-11 22:01:49,765 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6cc72c336e19f98e5877c5855d5e076c: 2023-07-11 22:01:49,765 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,765 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 22:01:49,765 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf/a7a07485189f42bd909bda2f9a3189a3] hfiles 2023-07-11 22:01:49,765 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf/a7a07485189f42bd909bda2f9a3189a3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,799 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. completed. 2023-07-11 22:01:49,799 DEBUG [rs(jenkins-hbase5.apache.org,37459,1689112712887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:01:49,799 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:49,799 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:49,799 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,803 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 22:01:49,804 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,37459,1689112712887' in zk 2023-07-11 22:01:49,805 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 22:01:49,805 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,806 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,806 DEBUG [member: 'jenkins-hbase5.apache.org,37459,1689112712887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 22:01:49,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,810 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. completed. 2023-07-11 22:01:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,810 DEBUG [rs(jenkins-hbase5.apache.org,36649,1689112713270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:01:49,810 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 22:01:49,810 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 22:01:49,810 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,810 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 22:01:49,810 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,36649,1689112713270' in zk 2023-07-11 22:01:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,812 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,812 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 22:01:49,812 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,812 DEBUG [member: 'jenkins-hbase5.apache.org,36649,1689112713270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 22:01:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,37459,1689112712887': 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,37459,1689112712887' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,36649,1689112713270': 2023-07-11 22:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36649,1689112713270' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 22:01:49,819 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 22:01:49,820 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 22:01:49,820 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 22:01:49,820 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,820 INFO [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 22:01:49,821 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,821 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,821 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,821 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,821 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,822 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,822 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 22:01:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 22:01:49,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,822 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 22:01:49,823 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,824 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 22:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,826 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 22:01:49,826 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,827 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,831 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,832 DEBUG [(jenkins-hbase5.apache.org,33801,1689112710414)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 22:01:49,832 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 22:01:49,832 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:01:49,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 22:01:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 22:01:49,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,834 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 22:01:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 22:01:49,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,932 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:49,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 22:01:49,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 22:01:49,933 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 22:01:49,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 22:01:49,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,959 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:49,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689112909628Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689112909834 (+206 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689112909834Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689112909838 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689112909883 (+45 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689112909958 (+75 ms) 2023-07-11 22:01:49,963 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 22:01:49,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 335 msec 2023-07-11 22:01:50,233 DEBUG [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 22:01:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 22:01:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 22:01:50,234 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234 2023-07-11 22:01:50,235 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41803, tgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234, rawTgtDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234, srcFsUri=hdfs://localhost:41803, srcDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:01:50,268 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94 2023-07-11 22:01:50,268 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2043318766_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:50,268 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41803, inputRoot=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94, snapshotDir=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-11 22:01:50,289 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:01:50,434 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:50,435 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:50,435 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:50,436 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,755 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-6649907479483382340.jar 2023-07-11 22:01:51,756 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,756 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,849 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/hadoop-217624649973343921.jar 2023-07-11 22:01:51,850 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,850 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,851 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,851 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,852 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,852 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 22:01:51,853 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 22:01:51,854 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 22:01:51,854 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 22:01:51,855 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 22:01:51,855 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 22:01:51,856 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 22:01:51,857 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 22:01:51,857 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 22:01:51,858 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 22:01:51,858 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 22:01:51,859 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:51,860 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:51,861 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:51,861 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:51,861 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 22:01:51,862 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:51,863 DEBUG [Listener at jenkins-hbase5.apache.org/41391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 22:01:52,490 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0006_000001 (auth:SIMPLE) 2023-07-11 22:01:52,865 WARN [Listener at jenkins-hbase5.apache.org/41391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 22:01:52,868 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-11 22:01:52,870 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 22:01:52,921 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:01:52,921 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 22:01:53,365 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 22:01:53,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0007_000001 (auth:SIMPLE) 2023-07-11 22:01:59,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0007_000001 (auth:SIMPLE) 2023-07-11 22:02:01,623 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0007_000001 (auth:SIMPLE) 2023-07-11 22:02:05,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689112732077_0007_000001 (auth:SIMPLE) 2023-07-11 22:02:07,073 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 22:02:07,073 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 22:02:07,080 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,080 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 22:02:07,080 INFO [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 22:02:07,080 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,081 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 22:02:07,081 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 22:02:07,081 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1485843396_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,081 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 22:02:07,081 DEBUG [Listener at jenkins-hbase5.apache.org/41391] snapshot.TestExportSnapshot(367): hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/export-test/export-1689112910234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 22:02:07,096 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 22:02:07,101 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112927101"}]},"ts":"1689112927101"} 2023-07-11 22:02:07,103 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-11 22:02:07,104 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-11 22:02:07,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, UNASSIGN}] 2023-07-11 22:02:07,116 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, UNASSIGN 2023-07-11 22:02:07,116 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, UNASSIGN 2023-07-11 22:02:07,118 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6cc72c336e19f98e5877c5855d5e076c, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:02:07,118 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=92e170d65fc47dd0cad8c440cee56fe2, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:02:07,121 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112927118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112927118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112927118"}]},"ts":"1689112927118"} 2023-07-11 22:02:07,121 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112927118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689112927118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689112927118"}]},"ts":"1689112927118"} 2023-07-11 22:02:07,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6cc72c336e19f98e5877c5855d5e076c, server=jenkins-hbase5.apache.org,36649,1689112713270}] 2023-07-11 22:02:07,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 92e170d65fc47dd0cad8c440cee56fe2, server=jenkins-hbase5.apache.org,37459,1689112712887}] 2023-07-11 22:02:07,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 22:02:07,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:02:07,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6cc72c336e19f98e5877c5855d5e076c, disabling compactions & flushes 2023-07-11 22:02:07,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:02:07,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:02:07,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. after waiting 0 ms 2023-07-11 22:02:07,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:02:07,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:02:07,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 92e170d65fc47dd0cad8c440cee56fe2, disabling compactions & flushes 2023-07-11 22:02:07,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:02:07,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:02:07,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. after waiting 0 ms 2023-07-11 22:02:07,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:02:07,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:02:07,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:02:07,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:07,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c. 2023-07-11 22:02:07,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6cc72c336e19f98e5877c5855d5e076c: 2023-07-11 22:02:07,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:07,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2. 2023-07-11 22:02:07,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 92e170d65fc47dd0cad8c440cee56fe2: 2023-07-11 22:02:07,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:02:07,365 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6cc72c336e19f98e5877c5855d5e076c, regionState=CLOSED 2023-07-11 22:02:07,365 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112927365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112927365"}]},"ts":"1689112927365"} 2023-07-11 22:02:07,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:02:07,369 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=92e170d65fc47dd0cad8c440cee56fe2, regionState=CLOSED 2023-07-11 22:02:07,369 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689112927368"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689112927368"}]},"ts":"1689112927368"} 2023-07-11 22:02:07,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-11 22:02:07,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6cc72c336e19f98e5877c5855d5e076c, server=jenkins-hbase5.apache.org,36649,1689112713270 in 247 msec 2023-07-11 22:02:07,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-11 22:02:07,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 92e170d65fc47dd0cad8c440cee56fe2, server=jenkins-hbase5.apache.org,37459,1689112712887 in 246 msec 2023-07-11 22:02:07,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cc72c336e19f98e5877c5855d5e076c, UNASSIGN in 268 msec 2023-07-11 22:02:07,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-11 22:02:07,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=92e170d65fc47dd0cad8c440cee56fe2, UNASSIGN in 269 msec 2023-07-11 22:02:07,376 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689112927376"}]},"ts":"1689112927376"} 2023-07-11 22:02:07,377 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-11 22:02:07,379 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-11 22:02:07,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 286 msec 2023-07-11 22:02:07,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 22:02:07,404 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-11 22:02:07,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,407 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,408 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,409 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,413 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:02:07,413 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:02:07,414 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,414 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,414 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,414 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 22:02:07,415 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/recovered.edits] 2023-07-11 22:02:07,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 22:02:07,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 22:02:07,416 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf, FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/recovered.edits] 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,416 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 22:02:07,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 22:02:07,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-11 22:02:07,419 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 22:02:07,424 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf/a7a07485189f42bd909bda2f9a3189a3 to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/cf/a7a07485189f42bd909bda2f9a3189a3 2023-07-11 22:02:07,425 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf/c84a5734f52a456ab84058bd29d4a1fb to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/cf/c84a5734f52a456ab84058bd29d4a1fb 2023-07-11 22:02:07,429 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c/recovered.edits/9.seqid 2023-07-11 22:02:07,429 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/recovered.edits/9.seqid to hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2/recovered.edits/9.seqid 2023-07-11 22:02:07,429 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cc72c336e19f98e5877c5855d5e076c 2023-07-11 22:02:07,429 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/92e170d65fc47dd0cad8c440cee56fe2 2023-07-11 22:02:07,429 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 22:02:07,431 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,433 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-11 22:02:07,436 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-11 22:02:07,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-11 22:02:07,437 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112927437"}]},"ts":"9223372036854775807"} 2023-07-11 22:02:07,437 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689112927437"}]},"ts":"9223372036854775807"} 2023-07-11 22:02:07,439 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 22:02:07,439 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6cc72c336e19f98e5877c5855d5e076c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689112908070.6cc72c336e19f98e5877c5855d5e076c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 92e170d65fc47dd0cad8c440cee56fe2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689112908070.92e170d65fc47dd0cad8c440cee56fe2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 22:02:07,439 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-11 22:02:07,439 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689112927439"}]},"ts":"9223372036854775807"} 2023-07-11 22:02:07,446 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-11 22:02:07,448 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 44 msec 2023-07-11 22:02:07,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 22:02:07,519 INFO [Listener at jenkins-hbase5.apache.org/41391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-11 22:02:07,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 22:02:07,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 22:02:07,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 22:02:07,585 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 769), OpenFileDescriptor=898 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1207 (was 1186) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=752 (was 2013) 2023-07-11 22:02:07,585 WARN [Listener at jenkins-hbase5.apache.org/41391] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-11 22:02:07,585 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-11 22:02:07,613 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-11 22:02:07,788 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689112732077_0007_01_000001 is : 143 2023-07-11 22:02:12,932 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 22:02:21,744 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-11 22:02:35,860 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 22:02:35,861 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-11 22:02:35,968 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-11 22:02:35,973 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-11 22:02:35,975 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 22:02:35,982 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-11 22:02:36,086 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 22:02:36,086 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-11 22:02:36,086 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 22:02:36,086 INFO [Listener at jenkins-hbase5.apache.org/41391] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 22:02:36,086 DEBUG [Listener at jenkins-hbase5.apache.org/41391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x776a4d8e to 127.0.0.1:58667 2023-07-11 22:02:36,086 DEBUG [Listener at jenkins-hbase5.apache.org/41391] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,087 DEBUG [Listener at jenkins-hbase5.apache.org/41391] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 22:02:36,087 DEBUG [Listener at jenkins-hbase5.apache.org/41391] util.JVMClusterUtil(257): Found active master hash=1467140829, stopped=false 2023-07-11 22:02:36,087 DEBUG [Listener at jenkins-hbase5.apache.org/41391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,087 DEBUG [Listener at jenkins-hbase5.apache.org/41391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 22:02:36,087 INFO [Listener at jenkins-hbase5.apache.org/41391] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 22:02:36,088 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 22:02:36,088 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 22:02:36,089 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 22:02:36,089 INFO [Listener at jenkins-hbase5.apache.org/41391] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 22:02:36,089 DEBUG [Listener at jenkins-hbase5.apache.org/41391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f8fc9e5 to 127.0.0.1:58667 2023-07-11 22:02:36,089 DEBUG [Listener at jenkins-hbase5.apache.org/41391] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,089 INFO [Listener at jenkins-hbase5.apache.org/41391] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,37459,1689112712887' ***** 2023-07-11 22:02:36,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 22:02:36,089 DEBUG [Listener at jenkins-hbase5.apache.org/41391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,089 INFO [Listener at jenkins-hbase5.apache.org/41391] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 22:02:36,089 INFO [Listener at jenkins-hbase5.apache.org/41391] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,34709,1689112713115' ***** 2023-07-11 22:02:36,090 DEBUG [Listener at jenkins-hbase5.apache.org/41391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,090 INFO [Listener at jenkins-hbase5.apache.org/41391] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 22:02:36,090 INFO [Listener at jenkins-hbase5.apache.org/41391] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,36649,1689112713270' ***** 2023-07-11 22:02:36,090 DEBUG [Listener at jenkins-hbase5.apache.org/41391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,090 INFO [RS:1;jenkins-hbase5:34709] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 22:02:36,090 INFO [RS:1;jenkins-hbase5:34709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 22:02:36,090 INFO [RS:0;jenkins-hbase5:37459] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 22:02:36,091 INFO [RS:0;jenkins-hbase5:37459] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 22:02:36,091 INFO [RS:1;jenkins-hbase5:34709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 22:02:36,091 INFO [RS:0;jenkins-hbase5:37459] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 22:02:36,091 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:02:36,091 DEBUG [RS:0;jenkins-hbase5:37459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d0886ac to 127.0.0.1:58667 2023-07-11 22:02:36,091 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(3305): Received CLOSE for a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 22:02:36,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 22:02:36,092 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:02:36,092 DEBUG [RS:1;jenkins-hbase5:34709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53233c4f to 127.0.0.1:58667 2023-07-11 22:02:36,091 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 22:02:36,090 INFO [Listener at jenkins-hbase5.apache.org/41391] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 22:02:36,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing a1ee2f2e57ba767fb0915cd9b774e602, disabling compactions & flushes 2023-07-11 22:02:36,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 22:02:36,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 22:02:36,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. after waiting 0 ms 2023-07-11 22:02:36,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 22:02:36,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing a1ee2f2e57ba767fb0915cd9b774e602 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-11 22:02:36,092 DEBUG [RS:1;jenkins-hbase5:34709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,092 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 22:02:36,091 DEBUG [RS:0;jenkins-hbase5:37459] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,091 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 22:02:36,099 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 22:02:36,096 INFO [RS:1;jenkins-hbase5:34709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 22:02:36,094 INFO [RS:2;jenkins-hbase5:36649] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 22:02:36,100 INFO [RS:2;jenkins-hbase5:36649] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 22:02:36,100 INFO [RS:1;jenkins-hbase5:34709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 22:02:36,100 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 22:02:36,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 22:02:36,100 INFO [RS:2;jenkins-hbase5:36649] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 22:02:36,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 22:02:36,100 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(3305): Received CLOSE for fe36995c45b29e8fb799e440fc044261 2023-07-11 22:02:36,100 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:02:36,100 DEBUG [RS:2;jenkins-hbase5:36649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x365c2d0d to 127.0.0.1:58667 2023-07-11 22:02:36,100 DEBUG [RS:2;jenkins-hbase5:36649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,100 INFO [RS:1;jenkins-hbase5:34709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 22:02:36,107 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 22:02:36,104 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,37459,1689112712887; all regions closed. 2023-07-11 22:02:36,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fe36995c45b29e8fb799e440fc044261, disabling compactions & flushes 2023-07-11 22:02:36,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 22:02:36,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 22:02:36,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. after waiting 0 ms 2023-07-11 22:02:36,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 22:02:36,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing fe36995c45b29e8fb799e440fc044261 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 22:02:36,104 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 22:02:36,111 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1478): Online Regions={fe36995c45b29e8fb799e440fc044261=hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261.} 2023-07-11 22:02:36,112 DEBUG [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1504): Waiting on fe36995c45b29e8fb799e440fc044261 2023-07-11 22:02:36,113 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-11 22:02:36,113 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, a1ee2f2e57ba767fb0915cd9b774e602=hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602.} 2023-07-11 22:02:36,113 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1504): Waiting on 1588230740, a1ee2f2e57ba767fb0915cd9b774e602 2023-07-11 22:02:36,159 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 22:02:36,160 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 22:02:36,163 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 22:02:36,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 22:02:36,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 22:02:36,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 22:02:36,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 22:02:36,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 22:02:36,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-11 22:02:36,204 DEBUG [RS:0;jenkins-hbase5:37459] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs 2023-07-11 22:02:36,204 INFO [RS:0;jenkins-hbase5:37459] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C37459%2C1689112712887:(num 1689112716823) 2023-07-11 22:02:36,204 DEBUG [RS:0;jenkins-hbase5:37459] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,204 INFO [RS:0;jenkins-hbase5:37459] regionserver.LeaseManager(133): Closed leases 2023-07-11 22:02:36,213 INFO [RS:0;jenkins-hbase5:37459] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 22:02:36,213 INFO [RS:0;jenkins-hbase5:37459] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 22:02:36,213 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 22:02:36,213 INFO [RS:0;jenkins-hbase5:37459] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 22:02:36,213 INFO [RS:0;jenkins-hbase5:37459] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 22:02:36,255 INFO [RS:0;jenkins-hbase5:37459] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:37459 2023-07-11 22:02:36,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/.tmp/info/d367c90a2fff46edaee3b427d2d3fdad 2023-07-11 22:02:36,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/.tmp/l/33c4df4adc714cea862079aa1a2855eb 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,37459,1689112712887 2023-07-11 22:02:36,273 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 22:02:36,273 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,37459,1689112712887] 2023-07-11 22:02:36,275 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/.tmp/info/2b36530a1120429ba292c04b9a095ce5 2023-07-11 22:02:36,276 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,37459,1689112712887; numProcessing=1 2023-07-11 22:02:36,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/.tmp/info/d367c90a2fff46edaee3b427d2d3fdad as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/info/d367c90a2fff46edaee3b427d2d3fdad 2023-07-11 22:02:36,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 33c4df4adc714cea862079aa1a2855eb 2023-07-11 22:02:36,280 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,37459,1689112712887 already deleted, retry=false 2023-07-11 22:02:36,280 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,37459,1689112712887 expired; onlineServers=2 2023-07-11 22:02:36,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/info/d367c90a2fff46edaee3b427d2d3fdad, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 22:02:36,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/.tmp/l/33c4df4adc714cea862079aa1a2855eb as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/l/33c4df4adc714cea862079aa1a2855eb 2023-07-11 22:02:36,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fe36995c45b29e8fb799e440fc044261 in 173ms, sequenceid=6, compaction requested=false 2023-07-11 22:02:36,286 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b36530a1120429ba292c04b9a095ce5 2023-07-11 22:02:36,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 33c4df4adc714cea862079aa1a2855eb 2023-07-11 22:02:36,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/l/33c4df4adc714cea862079aa1a2855eb, entries=7, sequenceid=18, filesize=5.2 K 2023-07-11 22:02:36,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/namespace/fe36995c45b29e8fb799e440fc044261/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 22:02:36,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 22:02:36,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fe36995c45b29e8fb799e440fc044261: 2023-07-11 22:02:36,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689112717737.fe36995c45b29e8fb799e440fc044261. 2023-07-11 22:02:36,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a1ee2f2e57ba767fb0915cd9b774e602 in 199ms, sequenceid=18, compaction requested=false 2023-07-11 22:02:36,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/acl/a1ee2f2e57ba767fb0915cd9b774e602/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-11 22:02:36,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 22:02:36,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for a1ee2f2e57ba767fb0915cd9b774e602: 2023-07-11 22:02:36,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689112718829.a1ee2f2e57ba767fb0915cd9b774e602. 2023-07-11 22:02:36,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/.tmp/rep_barrier/490946fd84074964a753a4713e0e8afc 2023-07-11 22:02:36,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 490946fd84074964a753a4713e0e8afc 2023-07-11 22:02:36,312 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,36649,1689112713270; all regions closed. 2023-07-11 22:02:36,314 DEBUG [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 22:02:36,337 DEBUG [RS:2;jenkins-hbase5:36649] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs 2023-07-11 22:02:36,337 INFO [RS:2;jenkins-hbase5:36649] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C36649%2C1689112713270:(num 1689112716824) 2023-07-11 22:02:36,337 DEBUG [RS:2;jenkins-hbase5:36649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,337 INFO [RS:2;jenkins-hbase5:36649] regionserver.LeaseManager(133): Closed leases 2023-07-11 22:02:36,337 INFO [RS:2;jenkins-hbase5:36649] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 22:02:36,338 INFO [RS:2;jenkins-hbase5:36649] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 22:02:36,338 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 22:02:36,338 INFO [RS:2;jenkins-hbase5:36649] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 22:02:36,339 INFO [RS:2;jenkins-hbase5:36649] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 22:02:36,340 INFO [RS:2;jenkins-hbase5:36649] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:36649 2023-07-11 22:02:36,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:02:36,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 22:02:36,341 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,36649,1689112713270 2023-07-11 22:02:36,342 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,36649,1689112713270] 2023-07-11 22:02:36,342 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,36649,1689112713270; numProcessing=2 2023-07-11 22:02:36,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/.tmp/table/037ea966556843b9b018ff586cd14b6d 2023-07-11 22:02:36,343 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,36649,1689112713270 already deleted, retry=false 2023-07-11 22:02:36,343 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,36649,1689112713270 expired; onlineServers=1 2023-07-11 22:02:36,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 037ea966556843b9b018ff586cd14b6d 2023-07-11 22:02:36,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/.tmp/info/2b36530a1120429ba292c04b9a095ce5 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/info/2b36530a1120429ba292c04b9a095ce5 2023-07-11 22:02:36,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b36530a1120429ba292c04b9a095ce5 2023-07-11 22:02:36,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/info/2b36530a1120429ba292c04b9a095ce5, entries=48, sequenceid=131, filesize=10.3 K 2023-07-11 22:02:36,353 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/.tmp/rep_barrier/490946fd84074964a753a4713e0e8afc as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/rep_barrier/490946fd84074964a753a4713e0e8afc 2023-07-11 22:02:36,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 490946fd84074964a753a4713e0e8afc 2023-07-11 22:02:36,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/rep_barrier/490946fd84074964a753a4713e0e8afc, entries=13, sequenceid=131, filesize=6.4 K 2023-07-11 22:02:36,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/.tmp/table/037ea966556843b9b018ff586cd14b6d as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/table/037ea966556843b9b018ff586cd14b6d 2023-07-11 22:02:36,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 037ea966556843b9b018ff586cd14b6d 2023-07-11 22:02:36,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/table/037ea966556843b9b018ff586cd14b6d, entries=24, sequenceid=131, filesize=6.9 K 2023-07-11 22:02:36,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 196ms, sequenceid=131, compaction requested=false 2023-07-11 22:02:36,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-11 22:02:36,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 22:02:36,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 22:02:36,377 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,377 INFO [RS:0;jenkins-hbase5:37459] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,37459,1689112712887; zookeeper connection closed. 2023-07-11 22:02:36,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 22:02:36,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 22:02:36,377 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:37459-0x101c201523b0001, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,378 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@51538256] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@51538256 2023-07-11 22:02:36,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 22:02:36,477 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,478 INFO [RS:2;jenkins-hbase5:36649] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,36649,1689112713270; zookeeper connection closed. 2023-07-11 22:02:36,478 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:36649-0x101c201523b0003, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,478 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10d808c2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10d808c2 2023-07-11 22:02:36,514 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,34709,1689112713115; all regions closed. 2023-07-11 22:02:36,518 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 22:02:36,522 DEBUG [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs 2023-07-11 22:02:36,522 INFO [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C34709%2C1689112713115.meta:.meta(num 1689112717232) 2023-07-11 22:02:36,528 DEBUG [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/oldWALs 2023-07-11 22:02:36,528 INFO [RS:1;jenkins-hbase5:34709] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C34709%2C1689112713115:(num 1689112716821) 2023-07-11 22:02:36,528 DEBUG [RS:1;jenkins-hbase5:34709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,528 INFO [RS:1;jenkins-hbase5:34709] regionserver.LeaseManager(133): Closed leases 2023-07-11 22:02:36,528 INFO [RS:1;jenkins-hbase5:34709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 22:02:36,528 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 22:02:36,529 INFO [RS:1;jenkins-hbase5:34709] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:34709 2023-07-11 22:02:36,532 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 22:02:36,532 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,34709,1689112713115 2023-07-11 22:02:36,532 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,34709,1689112713115] 2023-07-11 22:02:36,532 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,34709,1689112713115; numProcessing=3 2023-07-11 22:02:36,534 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,34709,1689112713115 already deleted, retry=false 2023-07-11 22:02:36,534 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,34709,1689112713115 expired; onlineServers=0 2023-07-11 22:02:36,534 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,33801,1689112710414' ***** 2023-07-11 22:02:36,534 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 22:02:36,535 DEBUG [M:0;jenkins-hbase5:33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@164fc0e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 22:02:36,535 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,33801,1689112710414 2023-07-11 22:02:36,535 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,33801,1689112710414; all regions closed. 2023-07-11 22:02:36,535 DEBUG [M:0;jenkins-hbase5:33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 22:02:36,535 DEBUG [M:0;jenkins-hbase5:33801] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 22:02:36,535 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 22:02:36,535 DEBUG [M:0;jenkins-hbase5:33801] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 22:02:36,535 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689112716027] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689112716027,5,FailOnTimeoutGroup] 2023-07-11 22:02:36,535 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689112716018] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689112716018,5,FailOnTimeoutGroup] 2023-07-11 22:02:36,535 INFO [M:0;jenkins-hbase5:33801] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 22:02:36,535 INFO [M:0;jenkins-hbase5:33801] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 22:02:36,536 INFO [M:0;jenkins-hbase5:33801] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-11 22:02:36,536 DEBUG [M:0;jenkins-hbase5:33801] master.HMaster(1512): Stopping service threads 2023-07-11 22:02:36,536 INFO [M:0;jenkins-hbase5:33801] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 22:02:36,536 ERROR [M:0;jenkins-hbase5:33801] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-11 22:02:36,536 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 22:02:36,537 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 22:02:36,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 22:02:36,537 INFO [M:0;jenkins-hbase5:33801] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 22:02:36,537 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 22:02:36,537 DEBUG [M:0;jenkins-hbase5:33801] zookeeper.ZKUtil(398): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 22:02:36,537 WARN [M:0;jenkins-hbase5:33801] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 22:02:36,537 INFO [M:0;jenkins-hbase5:33801] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 22:02:36,538 INFO [M:0;jenkins-hbase5:33801] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 22:02:36,538 DEBUG [M:0;jenkins-hbase5:33801] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 22:02:36,538 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 22:02:36,538 DEBUG [M:0;jenkins-hbase5:33801] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 22:02:36,538 DEBUG [M:0;jenkins-hbase5:33801] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 22:02:36,538 DEBUG [M:0;jenkins-hbase5:33801] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 22:02:36,539 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=372.98 KB heapSize=449.14 KB 2023-07-11 22:02:36,552 INFO [M:0;jenkins-hbase5:33801] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=372.98 KB at sequenceid=898 (bloomFilter=true), to=hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd328960f61444a8a91b7ebe549a61f5 2023-07-11 22:02:36,556 INFO [M:0;jenkins-hbase5:33801] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd328960f61444a8a91b7ebe549a61f5 2023-07-11 22:02:36,557 DEBUG [M:0;jenkins-hbase5:33801] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd328960f61444a8a91b7ebe549a61f5 as hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd328960f61444a8a91b7ebe549a61f5 2023-07-11 22:02:36,561 INFO [M:0;jenkins-hbase5:33801] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd328960f61444a8a91b7ebe549a61f5 2023-07-11 22:02:36,561 INFO [M:0;jenkins-hbase5:33801] regionserver.HStore(1080): Added hdfs://localhost:41803/user/jenkins/test-data/852ee752-5804-c6e5-e29d-364afa207c94/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd328960f61444a8a91b7ebe549a61f5, entries=119, sequenceid=898, filesize=28.4 K 2023-07-11 22:02:36,562 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegion(2948): Finished flush of dataSize ~372.98 KB/381927, heapSize ~449.13 KB/459904, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=898, compaction requested=false 2023-07-11 22:02:36,564 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 22:02:36,564 DEBUG [M:0;jenkins-hbase5:33801] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 22:02:36,568 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 22:02:36,568 INFO [M:0;jenkins-hbase5:33801] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 22:02:36,569 INFO [M:0;jenkins-hbase5:33801] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:33801 2023-07-11 22:02:36,571 DEBUG [M:0;jenkins-hbase5:33801] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,33801,1689112710414 already deleted, retry=false 2023-07-11 22:02:36,634 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,635 INFO [RS:1;jenkins-hbase5:34709] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,34709,1689112713115; zookeeper connection closed. 2023-07-11 22:02:36,635 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): regionserver:34709-0x101c201523b0002, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,635 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ea20da5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ea20da5 2023-07-11 22:02:36,635 INFO [Listener at jenkins-hbase5.apache.org/41391] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 22:02:36,735 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,735 INFO [M:0;jenkins-hbase5:33801] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,33801,1689112710414; zookeeper connection closed. 2023-07-11 22:02:36,735 DEBUG [Listener at localhost/34469-EventThread] zookeeper.ZKWatcher(600): master:33801-0x101c201523b0000, quorum=127.0.0.1:58667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 22:02:36,737 WARN [Listener at jenkins-hbase5.apache.org/41391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 22:02:36,741 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 22:02:36,845 WARN [BP-598509149-172.31.10.131-1689112702928 heartbeating to localhost/127.0.0.1:41803] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 22:02:36,845 WARN [BP-598509149-172.31.10.131-1689112702928 heartbeating to localhost/127.0.0.1:41803] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-598509149-172.31.10.131-1689112702928 (Datanode Uuid 6fa56d19-15a7-4d6f-898b-55beed307cbc) service to localhost/127.0.0.1:41803 2023-07-11 22:02:36,847 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data5/current/BP-598509149-172.31.10.131-1689112702928] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 22:02:36,847 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data6/current/BP-598509149-172.31.10.131-1689112702928] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 22:02:36,848 WARN [Listener at jenkins-hbase5.apache.org/41391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 22:02:36,851 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 22:02:36,954 WARN [BP-598509149-172.31.10.131-1689112702928 heartbeating to localhost/127.0.0.1:41803] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 22:02:36,954 WARN [BP-598509149-172.31.10.131-1689112702928 heartbeating to localhost/127.0.0.1:41803] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-598509149-172.31.10.131-1689112702928 (Datanode Uuid ce121982-e083-4225-b9b6-1f03f9aa8509) service to localhost/127.0.0.1:41803 2023-07-11 22:02:36,955 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data3/current/BP-598509149-172.31.10.131-1689112702928] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 22:02:36,955 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data4/current/BP-598509149-172.31.10.131-1689112702928] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 22:02:36,956 WARN [Listener at jenkins-hbase5.apache.org/41391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 22:02:36,961 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 22:02:37,063 WARN [BP-598509149-172.31.10.131-1689112702928 heartbeating to localhost/127.0.0.1:41803] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 22:02:37,063 WARN [BP-598509149-172.31.10.131-1689112702928 heartbeating to localhost/127.0.0.1:41803] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-598509149-172.31.10.131-1689112702928 (Datanode Uuid 551e84d3-86c6-4f36-b07d-511a4c0763d2) service to localhost/127.0.0.1:41803 2023-07-11 22:02:37,064 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data1/current/BP-598509149-172.31.10.131-1689112702928] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 22:02:37,065 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4@2/hbase-mapreduce/target/test-data/519e2124-f8fe-dc03-fecc-de77feed8068/cluster_4399b2ff-96c7-d0ef-f4c9-ff6e19db2800/dfs/data/data2/current/BP-598509149-172.31.10.131-1689112702928] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 22:02:37,087 INFO [Listener at jenkins-hbase5.apache.org/41391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 22:02:37,210 INFO [Listener at jenkins-hbase5.apache.org/41391] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 22:02:37,290 INFO [Listener at jenkins-hbase5.apache.org/41391] hbase.HBaseTestingUtility(1293): Minicluster is down