2023-07-19 00:10:13,693 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 00:10:13,977 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e 2023-07-19 00:10:13,977 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-19 00:10:13,978 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-19 00:10:14,024 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 00:10:14,297 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 00:10:14,298 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986, deleteOnExit=true 2023-07-19 00:10:14,298 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 00:10:14,299 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/test.cache.data in system properties and HBase conf 2023-07-19 00:10:14,299 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 00:10:14,300 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop.log.dir in system properties and HBase conf 2023-07-19 00:10:14,300 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 00:10:14,301 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 00:10:14,301 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 00:10:14,652 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 00:10:14,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:14,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:14,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 00:10:14,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:14,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 00:10:14,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 00:10:14,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:14,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:14,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 00:10:14,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/nfs.dump.dir in system properties and HBase conf 2023-07-19 00:10:14,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir in system properties and HBase conf 2023-07-19 00:10:14,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:14,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 00:10:14,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 00:10:15,251 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 00:10:15,255 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 00:10:15,532 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 00:10:15,733 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 00:10:15,749 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:15,790 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:15,832 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_localhost_45815_hdfs____jxcuzp/webapp 2023-07-19 00:10:15,982 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45815 2023-07-19 00:10:16,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 00:10:16,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 00:10:16,532 WARN [Listener at localhost/40831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:16,633 WARN [Listener at localhost/40831] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 00:10:16,664 WARN [Listener at localhost/40831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:16,673 INFO [Listener at localhost/40831] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:16,682 INFO [Listener at localhost/40831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_localhost_40651_datanode____.pzirwj/webapp 2023-07-19 00:10:16,893 INFO [Listener at localhost/40831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40651 2023-07-19 00:10:17,422 WARN [Listener at localhost/46051] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:17,457 WARN [Listener at localhost/46051] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 00:10:17,463 WARN [Listener at localhost/46051] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:17,465 INFO [Listener at localhost/46051] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:17,474 INFO [Listener at localhost/46051] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_localhost_42665_datanode____dxsbi/webapp 2023-07-19 00:10:17,615 INFO [Listener at localhost/46051] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42665 2023-07-19 00:10:17,642 WARN [Listener at localhost/41855] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:17,703 WARN [Listener at localhost/41855] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 00:10:17,719 WARN [Listener at localhost/41855] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:17,722 INFO [Listener at localhost/41855] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:17,736 INFO [Listener at localhost/41855] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_localhost_36425_datanode____.15mzmt/webapp 2023-07-19 00:10:17,887 INFO [Listener at localhost/41855] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36425 2023-07-19 00:10:17,938 WARN [Listener at localhost/33023] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:18,104 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x784dc4bf9e6416ef: Processing first storage report for DS-8ea09410-1c72-4e31-94d7-457243bb9bb3 from datanode cbb57f4d-45de-42c1-8160-79bc727d05f4 2023-07-19 00:10:18,106 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x784dc4bf9e6416ef: from storage DS-8ea09410-1c72-4e31-94d7-457243bb9bb3 node DatanodeRegistration(127.0.0.1:44531, datanodeUuid=cbb57f4d-45de-42c1-8160-79bc727d05f4, infoPort=37717, infoSecurePort=0, ipcPort=46051, storageInfo=lv=-57;cid=testClusterID;nsid=610058833;c=1689725415331), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,107 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x784dc4bf9e6416ef: Processing first storage report for DS-b6692c1c-96b6-4254-a138-676132c7b27c from datanode cbb57f4d-45de-42c1-8160-79bc727d05f4 2023-07-19 00:10:18,108 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x784dc4bf9e6416ef: from storage DS-b6692c1c-96b6-4254-a138-676132c7b27c node DatanodeRegistration(127.0.0.1:44531, datanodeUuid=cbb57f4d-45de-42c1-8160-79bc727d05f4, infoPort=37717, infoSecurePort=0, ipcPort=46051, storageInfo=lv=-57;cid=testClusterID;nsid=610058833;c=1689725415331), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,109 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6704d57aaebe6330: Processing first storage report for DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6 from datanode 47e38a39-36c5-4434-88ca-63fcc95ffe84 2023-07-19 00:10:18,109 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6704d57aaebe6330: from storage DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6 node DatanodeRegistration(127.0.0.1:45281, datanodeUuid=47e38a39-36c5-4434-88ca-63fcc95ffe84, infoPort=41923, infoSecurePort=0, ipcPort=41855, storageInfo=lv=-57;cid=testClusterID;nsid=610058833;c=1689725415331), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,115 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6704d57aaebe6330: Processing first storage report for DS-72522b82-2489-43de-943f-1ca0897a10c9 from datanode 47e38a39-36c5-4434-88ca-63fcc95ffe84 2023-07-19 00:10:18,115 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6704d57aaebe6330: from storage DS-72522b82-2489-43de-943f-1ca0897a10c9 node DatanodeRegistration(127.0.0.1:45281, datanodeUuid=47e38a39-36c5-4434-88ca-63fcc95ffe84, infoPort=41923, infoSecurePort=0, ipcPort=41855, storageInfo=lv=-57;cid=testClusterID;nsid=610058833;c=1689725415331), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,133 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48fb7fd45170dd0: Processing first storage report for DS-58472011-c085-4627-928a-2c053c51d0c0 from datanode 03dc9f9e-dd16-408c-93f2-1d5f364d54f8 2023-07-19 00:10:18,133 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48fb7fd45170dd0: from storage DS-58472011-c085-4627-928a-2c053c51d0c0 node DatanodeRegistration(127.0.0.1:42985, datanodeUuid=03dc9f9e-dd16-408c-93f2-1d5f364d54f8, infoPort=38907, infoSecurePort=0, ipcPort=33023, storageInfo=lv=-57;cid=testClusterID;nsid=610058833;c=1689725415331), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,133 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48fb7fd45170dd0: Processing first storage report for DS-7fdb56aa-335e-43eb-8f90-04235778031f from datanode 03dc9f9e-dd16-408c-93f2-1d5f364d54f8 2023-07-19 00:10:18,134 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48fb7fd45170dd0: from storage DS-7fdb56aa-335e-43eb-8f90-04235778031f node DatanodeRegistration(127.0.0.1:42985, datanodeUuid=03dc9f9e-dd16-408c-93f2-1d5f364d54f8, infoPort=38907, infoSecurePort=0, ipcPort=33023, storageInfo=lv=-57;cid=testClusterID;nsid=610058833;c=1689725415331), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,395 DEBUG [Listener at localhost/33023] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e 2023-07-19 00:10:18,508 INFO [Listener at localhost/33023] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/zookeeper_0, clientPort=57509, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 00:10:18,533 INFO [Listener at localhost/33023] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57509 2023-07-19 00:10:18,543 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:18,546 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:19,266 INFO [Listener at localhost/33023] util.FSUtils(471): Created version file at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e with version=8 2023-07-19 00:10:19,267 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/hbase-staging 2023-07-19 00:10:19,661 INFO [Listener at localhost/33023] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 00:10:20,270 INFO [Listener at localhost/33023] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:20,306 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,307 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,307 INFO [Listener at localhost/33023] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:20,308 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,308 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:20,507 INFO [Listener at localhost/33023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:20,586 DEBUG [Listener at localhost/33023] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 00:10:20,699 INFO [Listener at localhost/33023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36871 2023-07-19 00:10:20,719 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,721 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,753 INFO [Listener at localhost/33023] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36871 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-07-19 00:10:20,812 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:368710x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:20,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36871-0x1017aea3ef60000 connected 2023-07-19 00:10:20,852 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:20,853 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:20,871 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:20,881 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36871 2023-07-19 00:10:20,882 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36871 2023-07-19 00:10:20,883 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36871 2023-07-19 00:10:20,883 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36871 2023-07-19 00:10:20,886 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36871 2023-07-19 00:10:20,895 INFO [Listener at localhost/33023] master.HMaster(444): hbase.rootdir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, hbase.cluster.distributed=false 2023-07-19 00:10:20,966 INFO [Listener at localhost/33023] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:20,966 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,967 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,967 INFO [Listener at localhost/33023] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:20,967 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,967 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:20,972 INFO [Listener at localhost/33023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:20,975 INFO [Listener at localhost/33023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42097 2023-07-19 00:10:20,978 INFO [Listener at localhost/33023] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 00:10:20,985 INFO [Listener at localhost/33023] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 00:10:20,986 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,989 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,991 INFO [Listener at localhost/33023] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42097 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-07-19 00:10:20,999 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:420970x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:21,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42097-0x1017aea3ef60001 connected 2023-07-19 00:10:21,000 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:21,002 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:21,003 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:21,010 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42097 2023-07-19 00:10:21,010 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42097 2023-07-19 00:10:21,011 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42097 2023-07-19 00:10:21,015 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42097 2023-07-19 00:10:21,015 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42097 2023-07-19 00:10:21,036 INFO [Listener at localhost/33023] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:21,036 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:21,037 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:21,037 INFO [Listener at localhost/33023] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:21,038 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:21,038 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:21,038 INFO [Listener at localhost/33023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:21,041 INFO [Listener at localhost/33023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43375 2023-07-19 00:10:21,041 INFO [Listener at localhost/33023] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 00:10:21,043 INFO [Listener at localhost/33023] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 00:10:21,044 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:21,046 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:21,048 INFO [Listener at localhost/33023] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43375 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-07-19 00:10:21,058 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:433750x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:21,059 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:433750x0, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:21,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43375-0x1017aea3ef60002 connected 2023-07-19 00:10:21,060 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:21,061 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:21,066 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43375 2023-07-19 00:10:21,066 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43375 2023-07-19 00:10:21,069 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43375 2023-07-19 00:10:21,072 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43375 2023-07-19 00:10:21,077 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43375 2023-07-19 00:10:21,096 INFO [Listener at localhost/33023] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:21,096 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:21,097 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:21,097 INFO [Listener at localhost/33023] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:21,097 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:21,097 INFO [Listener at localhost/33023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:21,098 INFO [Listener at localhost/33023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:21,099 INFO [Listener at localhost/33023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39975 2023-07-19 00:10:21,100 INFO [Listener at localhost/33023] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 00:10:21,101 INFO [Listener at localhost/33023] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 00:10:21,103 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:21,105 INFO [Listener at localhost/33023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:21,106 INFO [Listener at localhost/33023] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39975 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-07-19 00:10:21,111 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:399750x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:21,112 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:399750x0, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:21,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39975-0x1017aea3ef60003 connected 2023-07-19 00:10:21,113 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:21,114 DEBUG [Listener at localhost/33023] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:21,115 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39975 2023-07-19 00:10:21,115 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39975 2023-07-19 00:10:21,115 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39975 2023-07-19 00:10:21,116 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39975 2023-07-19 00:10:21,118 DEBUG [Listener at localhost/33023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39975 2023-07-19 00:10:21,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:21,135 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 00:10:21,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:21,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:21,170 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 00:10:21,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 00:10:21,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36871,1689725419478 from backup master directory 2023-07-19 00:10:21,180 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:21,180 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 00:10:21,181 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:21,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:21,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 00:10:21,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 00:10:21,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/hbase.id with ID: 7067b932-adc4-466b-a8ad-ab52ba20e441 2023-07-19 00:10:21,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:21,389 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:21,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x601f56c0 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:21,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76659979, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:21,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:21,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 00:10:21,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 00:10:21,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 00:10:21,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 00:10:21,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 00:10:21,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:21,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store-tmp 2023-07-19 00:10:21,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:21,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 00:10:21,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 00:10:21,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 00:10:21,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/WALs/jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:21,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36871%2C1689725419478, suffix=, logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/WALs/jenkins-hbase4.apache.org,36871,1689725419478, archiveDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/oldWALs, maxLogs=10 2023-07-19 00:10:21,865 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK] 2023-07-19 00:10:21,865 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK] 2023-07-19 00:10:21,866 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK] 2023-07-19 00:10:21,873 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 00:10:21,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/WALs/jenkins-hbase4.apache.org,36871,1689725419478/jenkins-hbase4.apache.org%2C36871%2C1689725419478.1689725421783 2023-07-19 00:10:21,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK], DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK], DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK]] 2023-07-19 00:10:21,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:21,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:21,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:22,032 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:22,040 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 00:10:22,071 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 00:10:22,085 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:22,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:22,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:22,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:22,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66755263, jitterRate=-0.005269065499305725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:22,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 00:10:22,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 00:10:22,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 00:10:22,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 00:10:22,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 00:10:22,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 00:10:22,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 46 msec 2023-07-19 00:10:22,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 00:10:22,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 00:10:22,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 00:10:22,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 00:10:22,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 00:10:22,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 00:10:22,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 00:10:22,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 00:10:22,326 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 00:10:22,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 00:10:22,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 00:10:22,356 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,356 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,356 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,356 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,357 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36871,1689725419478, sessionid=0x1017aea3ef60000, setting cluster-up flag (Was=false) 2023-07-19 00:10:22,384 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 00:10:22,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:22,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 00:10:22,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:22,411 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp 2023-07-19 00:10:22,426 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(951): ClusterId : 7067b932-adc4-466b-a8ad-ab52ba20e441 2023-07-19 00:10:22,460 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(951): ClusterId : 7067b932-adc4-466b-a8ad-ab52ba20e441 2023-07-19 00:10:22,462 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(951): ClusterId : 7067b932-adc4-466b-a8ad-ab52ba20e441 2023-07-19 00:10:22,467 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 00:10:22,467 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 00:10:22,467 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 00:10:22,474 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 00:10:22,474 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 00:10:22,475 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 00:10:22,475 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 00:10:22,479 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 00:10:22,479 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 00:10:22,485 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 00:10:22,491 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 00:10:22,492 DEBUG [RS:0;jenkins-hbase4:42097] zookeeper.ReadOnlyZKClient(139): Connect 0x087f00fd to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:22,494 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 00:10:22,498 DEBUG [RS:1;jenkins-hbase4:43375] zookeeper.ReadOnlyZKClient(139): Connect 0x0be92c0e to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:22,498 DEBUG [RS:2;jenkins-hbase4:39975] zookeeper.ReadOnlyZKClient(139): Connect 0x4364437b to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:22,533 DEBUG [RS:0;jenkins-hbase4:42097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@623e3306, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:22,535 DEBUG [RS:0;jenkins-hbase4:42097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282890fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:10:22,544 DEBUG [RS:1;jenkins-hbase4:43375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3841025d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:22,545 DEBUG [RS:1;jenkins-hbase4:43375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73c01e51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:10:22,545 DEBUG [RS:2;jenkins-hbase4:39975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@487b874b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:22,546 DEBUG [RS:2;jenkins-hbase4:39975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13fb7306, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:10:22,574 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42097 2023-07-19 00:10:22,577 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39975 2023-07-19 00:10:22,581 INFO [RS:0;jenkins-hbase4:42097] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 00:10:22,581 INFO [RS:0;jenkins-hbase4:42097] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 00:10:22,582 INFO [RS:2;jenkins-hbase4:39975] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 00:10:22,583 INFO [RS:2;jenkins-hbase4:39975] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 00:10:22,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 00:10:22,605 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 00:10:22,605 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 00:10:22,606 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43375 2023-07-19 00:10:22,606 INFO [RS:1;jenkins-hbase4:43375] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 00:10:22,606 INFO [RS:1;jenkins-hbase4:43375] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 00:10:22,606 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 00:10:22,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,608 INFO [RS:1;jenkins-hbase4:43375] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,607 INFO [RS:2;jenkins-hbase4:39975] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 00:10:22,607 INFO [RS:0;jenkins-hbase4:42097] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,608 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 00:10:22,608 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 00:10:22,608 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 00:10:22,612 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36871,1689725419478 with isa=jenkins-hbase4.apache.org/172.31.14.131:39975, startcode=1689725421095 2023-07-19 00:10:22,618 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36871,1689725419478 with isa=jenkins-hbase4.apache.org/172.31.14.131:42097, startcode=1689725420965 2023-07-19 00:10:22,619 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36871,1689725419478 with isa=jenkins-hbase4.apache.org/172.31.14.131:43375, startcode=1689725421035 2023-07-19 00:10:22,634 DEBUG [RS:2;jenkins-hbase4:39975] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 00:10:22,642 DEBUG [RS:1;jenkins-hbase4:43375] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 00:10:22,661 DEBUG [RS:0;jenkins-hbase4:42097] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 00:10:22,710 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59609, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 00:10:22,710 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37491, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 00:10:22,710 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51297, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 00:10:22,722 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36871] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 00:10:22,733 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36871] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 00:10:22,735 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36871] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 00:10:22,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 00:10:22,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 00:10:22,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:22,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,760 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 00:10:22,760 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 00:10:22,760 WARN [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 00:10:22,760 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 00:10:22,761 WARN [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 00:10:22,761 WARN [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 00:10:22,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689725452761 2023-07-19 00:10:22,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 00:10:22,771 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 00:10:22,771 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 00:10:22,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 00:10:22,778 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:22,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 00:10:22,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 00:10:22,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 00:10:22,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 00:10:22,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 00:10:22,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 00:10:22,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 00:10:22,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 00:10:22,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 00:10:22,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689725422802,5,FailOnTimeoutGroup] 2023-07-19 00:10:22,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689725422803,5,FailOnTimeoutGroup] 2023-07-19 00:10:22,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 00:10:22,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,848 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:22,849 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:22,850 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:22,862 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36871,1689725419478 with isa=jenkins-hbase4.apache.org/172.31.14.131:43375, startcode=1689725421035 2023-07-19 00:10:22,862 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36871,1689725419478 with isa=jenkins-hbase4.apache.org/172.31.14.131:39975, startcode=1689725421095 2023-07-19 00:10:22,862 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36871,1689725419478 with isa=jenkins-hbase4.apache.org/172.31.14.131:42097, startcode=1689725420965 2023-07-19 00:10:22,875 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36871] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:22,890 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36871] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:22,894 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:22,894 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40831 2023-07-19 00:10:22,895 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 00:10:22,895 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36871] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:22,899 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:22,899 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40831 2023-07-19 00:10:22,899 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 00:10:22,901 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:22,901 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40831 2023-07-19 00:10:22,901 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 00:10:22,902 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:22,903 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:10:22,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 00:10:22,908 DEBUG [RS:0;jenkins-hbase4:42097] zookeeper.ZKUtil(162): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:22,908 WARN [RS:0;jenkins-hbase4:42097] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:22,908 DEBUG [RS:2;jenkins-hbase4:39975] zookeeper.ZKUtil(162): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:22,909 INFO [RS:0;jenkins-hbase4:42097] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:22,909 WARN [RS:2;jenkins-hbase4:39975] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:22,909 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:22,910 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39975,1689725421095] 2023-07-19 00:10:22,910 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42097,1689725420965] 2023-07-19 00:10:22,910 DEBUG [RS:1;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:22,909 INFO [RS:2;jenkins-hbase4:39975] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:22,910 WARN [RS:1;jenkins-hbase4:43375] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:22,911 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:22,910 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43375,1689725421035] 2023-07-19 00:10:22,911 INFO [RS:1;jenkins-hbase4:43375] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:22,912 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:22,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/info 2023-07-19 00:10:22,914 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 00:10:22,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 00:10:22,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/rep_barrier 2023-07-19 00:10:22,924 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 00:10:22,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 00:10:22,926 DEBUG [RS:2;jenkins-hbase4:39975] zookeeper.ZKUtil(162): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:22,926 DEBUG [RS:1;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:22,926 DEBUG [RS:0;jenkins-hbase4:42097] zookeeper.ZKUtil(162): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:22,927 DEBUG [RS:2;jenkins-hbase4:39975] zookeeper.ZKUtil(162): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:22,928 DEBUG [RS:2;jenkins-hbase4:39975] zookeeper.ZKUtil(162): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:22,928 DEBUG [RS:0;jenkins-hbase4:42097] zookeeper.ZKUtil(162): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:22,929 DEBUG [RS:0;jenkins-hbase4:42097] zookeeper.ZKUtil(162): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:22,929 DEBUG [RS:1;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:22,929 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/table 2023-07-19 00:10:22,930 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 00:10:22,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,933 DEBUG [RS:1;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:22,939 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740 2023-07-19 00:10:22,939 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740 2023-07-19 00:10:22,948 DEBUG [RS:1;jenkins-hbase4:43375] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 00:10:22,948 DEBUG [RS:0;jenkins-hbase4:42097] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 00:10:22,950 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 00:10:22,956 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 00:10:22,961 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 00:10:22,963 INFO [RS:0;jenkins-hbase4:42097] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 00:10:22,963 INFO [RS:2;jenkins-hbase4:39975] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 00:10:22,969 INFO [RS:1;jenkins-hbase4:43375] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 00:10:22,989 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:22,991 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73307037, jitterRate=0.09235997498035431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 00:10:22,991 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 00:10:22,991 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 00:10:22,991 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 00:10:22,991 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 00:10:22,991 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 00:10:22,991 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 00:10:23,027 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 00:10:23,027 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 00:10:23,030 INFO [RS:2;jenkins-hbase4:39975] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 00:10:23,038 INFO [RS:0;jenkins-hbase4:42097] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 00:10:23,056 INFO [RS:1;jenkins-hbase4:43375] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 00:10:23,059 INFO [RS:2;jenkins-hbase4:39975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 00:10:23,060 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,063 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 00:10:23,062 INFO [RS:0;jenkins-hbase4:42097] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 00:10:23,064 INFO [RS:1;jenkins-hbase4:43375] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 00:10:23,064 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,067 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,066 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 00:10:23,067 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 00:10:23,079 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 00:10:23,080 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 00:10:23,092 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,092 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,092 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,092 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,093 DEBUG [RS:0;jenkins-hbase4:42097] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,092 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,096 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 00:10:23,103 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,103 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,112 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,112 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,112 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,112 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,112 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:23,113 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:1;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,113 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:23,114 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,114 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,114 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,114 DEBUG [RS:2;jenkins-hbase4:39975] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:23,117 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,117 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,117 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,123 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 00:10:23,130 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 00:10:23,130 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,131 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,131 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,139 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,139 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,139 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,154 INFO [RS:0;jenkins-hbase4:42097] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 00:10:23,160 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42097,1689725420965-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,164 INFO [RS:2;jenkins-hbase4:39975] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 00:10:23,169 INFO [RS:1;jenkins-hbase4:43375] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 00:10:23,183 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39975,1689725421095-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,183 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1689725421035-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,209 INFO [RS:2;jenkins-hbase4:39975] regionserver.Replication(203): jenkins-hbase4.apache.org,39975,1689725421095 started 2023-07-19 00:10:23,209 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39975,1689725421095, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39975, sessionid=0x1017aea3ef60003 2023-07-19 00:10:23,211 INFO [RS:1;jenkins-hbase4:43375] regionserver.Replication(203): jenkins-hbase4.apache.org,43375,1689725421035 started 2023-07-19 00:10:23,211 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43375,1689725421035, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43375, sessionid=0x1017aea3ef60002 2023-07-19 00:10:23,211 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 00:10:23,211 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 00:10:23,211 DEBUG [RS:1;jenkins-hbase4:43375] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:23,211 DEBUG [RS:1;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43375,1689725421035' 2023-07-19 00:10:23,211 DEBUG [RS:1;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 00:10:23,212 DEBUG [RS:1;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 00:10:23,213 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 00:10:23,213 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 00:10:23,213 DEBUG [RS:1;jenkins-hbase4:43375] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:23,213 DEBUG [RS:1;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43375,1689725421035' 2023-07-19 00:10:23,213 DEBUG [RS:1;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:23,214 DEBUG [RS:1;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:23,214 INFO [RS:0;jenkins-hbase4:42097] regionserver.Replication(203): jenkins-hbase4.apache.org,42097,1689725420965 started 2023-07-19 00:10:23,215 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42097,1689725420965, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42097, sessionid=0x1017aea3ef60001 2023-07-19 00:10:23,215 DEBUG [RS:1;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 00:10:23,215 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 00:10:23,215 INFO [RS:1;jenkins-hbase4:43375] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 00:10:23,211 DEBUG [RS:2;jenkins-hbase4:39975] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:23,216 INFO [RS:1;jenkins-hbase4:43375] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 00:10:23,215 DEBUG [RS:0;jenkins-hbase4:42097] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:23,216 DEBUG [RS:2;jenkins-hbase4:39975] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39975,1689725421095' 2023-07-19 00:10:23,217 DEBUG [RS:2;jenkins-hbase4:39975] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 00:10:23,217 DEBUG [RS:0;jenkins-hbase4:42097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42097,1689725420965' 2023-07-19 00:10:23,217 DEBUG [RS:0;jenkins-hbase4:42097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 00:10:23,217 DEBUG [RS:0;jenkins-hbase4:42097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 00:10:23,217 DEBUG [RS:2;jenkins-hbase4:39975] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 00:10:23,218 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 00:10:23,218 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 00:10:23,218 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 00:10:23,218 DEBUG [RS:0;jenkins-hbase4:42097] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:23,219 DEBUG [RS:0;jenkins-hbase4:42097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42097,1689725420965' 2023-07-19 00:10:23,219 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 00:10:23,219 DEBUG [RS:2;jenkins-hbase4:39975] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:23,219 DEBUG [RS:0;jenkins-hbase4:42097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:23,219 DEBUG [RS:2;jenkins-hbase4:39975] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39975,1689725421095' 2023-07-19 00:10:23,219 DEBUG [RS:2;jenkins-hbase4:39975] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:23,220 DEBUG [RS:0;jenkins-hbase4:42097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:23,220 DEBUG [RS:2;jenkins-hbase4:39975] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:23,221 DEBUG [RS:0;jenkins-hbase4:42097] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 00:10:23,221 DEBUG [RS:2;jenkins-hbase4:39975] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 00:10:23,222 INFO [RS:2;jenkins-hbase4:39975] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 00:10:23,221 INFO [RS:0;jenkins-hbase4:42097] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 00:10:23,222 INFO [RS:2;jenkins-hbase4:39975] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 00:10:23,223 INFO [RS:0;jenkins-hbase4:42097] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 00:10:23,282 DEBUG [jenkins-hbase4:36871] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 00:10:23,288 DEBUG [jenkins-hbase4:36871] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:23,295 DEBUG [jenkins-hbase4:36871] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:23,295 DEBUG [jenkins-hbase4:36871] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:23,295 DEBUG [jenkins-hbase4:36871] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:23,296 DEBUG [jenkins-hbase4:36871] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:23,299 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39975,1689725421095, state=OPENING 2023-07-19 00:10:23,309 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 00:10:23,311 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:23,312 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 00:10:23,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:10:23,334 INFO [RS:0;jenkins-hbase4:42097] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42097%2C1689725420965, suffix=, logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,42097,1689725420965, archiveDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs, maxLogs=32 2023-07-19 00:10:23,335 INFO [RS:1;jenkins-hbase4:43375] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43375%2C1689725421035, suffix=, logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,43375,1689725421035, archiveDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs, maxLogs=32 2023-07-19 00:10:23,336 INFO [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39975%2C1689725421095, suffix=, logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,39975,1689725421095, archiveDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs, maxLogs=32 2023-07-19 00:10:23,385 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK] 2023-07-19 00:10:23,391 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK] 2023-07-19 00:10:23,392 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK] 2023-07-19 00:10:23,398 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK] 2023-07-19 00:10:23,401 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK] 2023-07-19 00:10:23,402 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK] 2023-07-19 00:10:23,419 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK] 2023-07-19 00:10:23,419 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK] 2023-07-19 00:10:23,419 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK] 2023-07-19 00:10:23,429 INFO [RS:0;jenkins-hbase4:42097] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,42097,1689725420965/jenkins-hbase4.apache.org%2C42097%2C1689725420965.1689725423338 2023-07-19 00:10:23,429 INFO [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,39975,1689725421095/jenkins-hbase4.apache.org%2C39975%2C1689725421095.1689725423340 2023-07-19 00:10:23,430 DEBUG [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK], DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK], DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK]] 2023-07-19 00:10:23,431 DEBUG [RS:0;jenkins-hbase4:42097] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK], DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK], DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK]] 2023-07-19 00:10:23,447 INFO [RS:1;jenkins-hbase4:43375] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,43375,1689725421035/jenkins-hbase4.apache.org%2C43375%2C1689725421035.1689725423340 2023-07-19 00:10:23,454 DEBUG [RS:1;jenkins-hbase4:43375] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK], DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK], DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK]] 2023-07-19 00:10:23,512 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:23,515 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:10:23,519 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:10:23,538 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 00:10:23,539 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:23,543 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39975%2C1689725421095.meta, suffix=.meta, logDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,39975,1689725421095, archiveDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs, maxLogs=32 2023-07-19 00:10:23,566 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK] 2023-07-19 00:10:23,567 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK] 2023-07-19 00:10:23,574 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK] 2023-07-19 00:10:23,587 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/WALs/jenkins-hbase4.apache.org,39975,1689725421095/jenkins-hbase4.apache.org%2C39975%2C1689725421095.meta.1689725423544.meta 2023-07-19 00:10:23,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45281,DS-8ba5f0a8-e7b1-40f1-abd1-57f111fa71c6,DISK], DatanodeInfoWithStorage[127.0.0.1:44531,DS-8ea09410-1c72-4e31-94d7-457243bb9bb3,DISK], DatanodeInfoWithStorage[127.0.0.1:42985,DS-58472011-c085-4627-928a-2c053c51d0c0,DISK]] 2023-07-19 00:10:23,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:23,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 00:10:23,593 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:23,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 00:10:23,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 00:10:23,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 00:10:23,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 00:10:23,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:23,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 00:10:23,612 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 00:10:23,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 00:10:23,619 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/info 2023-07-19 00:10:23,619 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/info 2023-07-19 00:10:23,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 00:10:23,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:23,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 00:10:23,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/rep_barrier 2023-07-19 00:10:23,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/rep_barrier 2023-07-19 00:10:23,623 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 00:10:23,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:23,625 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 00:10:23,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/table 2023-07-19 00:10:23,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/table 2023-07-19 00:10:23,627 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 00:10:23,628 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:23,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740 2023-07-19 00:10:23,645 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740 2023-07-19 00:10:23,650 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 00:10:23,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 00:10:23,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59922021, jitterRate=-0.10709230601787567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 00:10:23,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 00:10:23,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689725423501 2023-07-19 00:10:23,725 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39975,1689725421095, state=OPEN 2023-07-19 00:10:23,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 00:10:23,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 00:10:23,733 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 00:10:23,733 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 00:10:23,739 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 00:10:23,739 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39975,1689725421095 in 416 msec 2023-07-19 00:10:23,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 00:10:23,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 643 msec 2023-07-19 00:10:23,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1320 sec 2023-07-19 00:10:23,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689725423759, completionTime=-1 2023-07-19 00:10:23,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 00:10:23,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 00:10:23,874 DEBUG [hconnection-0x35fb0b5b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:23,877 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:23,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 00:10:23,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689725483904 2023-07-19 00:10:23,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689725543904 2023-07-19 00:10:23,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 144 msec 2023-07-19 00:10:23,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36871,1689725419478-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36871,1689725419478-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36871,1689725419478-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36871, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,959 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 00:10:23,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 00:10:23,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:23,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 00:10:23,985 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:23,991 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:24,025 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,028 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77 empty. 2023-07-19 00:10:24,029 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,029 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 00:10:24,086 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:24,088 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec30c79cfc94ed61f17c077f3efb3d77, NAME => 'hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:10:24,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:24,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ec30c79cfc94ed61f17c077f3efb3d77, disabling compactions & flushes 2023-07-19 00:10:24,114 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. after waiting 0 ms 2023-07-19 00:10:24,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,115 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ec30c79cfc94ed61f17c077f3efb3d77: 2023-07-19 00:10:24,120 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:24,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689725424124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725424124"}]},"ts":"1689725424124"} 2023-07-19 00:10:24,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 00:10:24,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:24,180 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725424176"}]},"ts":"1689725424176"} 2023-07-19 00:10:24,185 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 00:10:24,190 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:24,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:24,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:24,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:24,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:24,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec30c79cfc94ed61f17c077f3efb3d77, ASSIGN}] 2023-07-19 00:10:24,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec30c79cfc94ed61f17c077f3efb3d77, ASSIGN 2023-07-19 00:10:24,199 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ec30c79cfc94ed61f17c077f3efb3d77, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:10:24,352 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 00:10:24,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec30c79cfc94ed61f17c077f3efb3d77, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:24,354 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689725424353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725424353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725424353"}]},"ts":"1689725424353"} 2023-07-19 00:10:24,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ec30c79cfc94ed61f17c077f3efb3d77, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:10:24,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec30c79cfc94ed61f17c077f3efb3d77, NAME => 'hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:24,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. service=AccessControlService 2023-07-19 00:10:24,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:24,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:24,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,532 INFO [StoreOpener-ec30c79cfc94ed61f17c077f3efb3d77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,535 DEBUG [StoreOpener-ec30c79cfc94ed61f17c077f3efb3d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/info 2023-07-19 00:10:24,535 DEBUG [StoreOpener-ec30c79cfc94ed61f17c077f3efb3d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/info 2023-07-19 00:10:24,536 INFO [StoreOpener-ec30c79cfc94ed61f17c077f3efb3d77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec30c79cfc94ed61f17c077f3efb3d77 columnFamilyName info 2023-07-19 00:10:24,537 INFO [StoreOpener-ec30c79cfc94ed61f17c077f3efb3d77-1] regionserver.HStore(310): Store=ec30c79cfc94ed61f17c077f3efb3d77/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:24,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:10:24,559 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:24,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec30c79cfc94ed61f17c077f3efb3d77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59900521, jitterRate=-0.1074126809835434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:24,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec30c79cfc94ed61f17c077f3efb3d77: 2023-07-19 00:10:24,563 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77., pid=6, masterSystemTime=1689725424513 2023-07-19 00:10:24,569 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,569 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:10:24,570 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec30c79cfc94ed61f17c077f3efb3d77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:24,570 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689725424569"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725424569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725424569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725424569"}]},"ts":"1689725424569"} 2023-07-19 00:10:24,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 00:10:24,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ec30c79cfc94ed61f17c077f3efb3d77, server=jenkins-hbase4.apache.org,39975,1689725421095 in 216 msec 2023-07-19 00:10:24,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 00:10:24,588 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ec30c79cfc94ed61f17c077f3efb3d77, ASSIGN in 389 msec 2023-07-19 00:10:24,589 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:24,589 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725424589"}]},"ts":"1689725424589"} 2023-07-19 00:10:24,592 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 00:10:24,599 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:24,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 635 msec 2023-07-19 00:10:24,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 00:10:24,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 00:10:24,687 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:24,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 00:10:24,780 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 00:10:24,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 66 msec 2023-07-19 00:10:24,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 00:10:24,818 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 00:10:24,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-07-19 00:10:24,842 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 00:10:24,845 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 00:10:24,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.665sec 2023-07-19 00:10:24,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 00:10:24,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 00:10:24,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 00:10:24,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36871,1689725419478-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 00:10:24,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36871,1689725419478-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 00:10:24,873 DEBUG [Listener at localhost/33023] zookeeper.ReadOnlyZKClient(139): Connect 0x572c911d to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:24,882 DEBUG [Listener at localhost/33023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd24843, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:24,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:24,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 00:10:24,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:24,897 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:24,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 00:10:24,903 DEBUG [hconnection-0x78b47ac1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:24,907 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/acl/feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:24,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/acl/feaa797b22f0c98625948f3592412afe empty. 2023-07-19 00:10:24,910 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/acl/feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:24,910 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 00:10:24,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:24,924 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:24,927 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:10:24,927 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/test.cache.data in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop.log.dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 00:10:24,928 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/nfs.dump.dir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 00:10:24,929 INFO [Listener at localhost/33023] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 00:10:24,952 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:24,954 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => feaa797b22f0c98625948f3592412afe, NAME => 'hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:10:25,001 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:25,002 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing feaa797b22f0c98625948f3592412afe, disabling compactions & flushes 2023-07-19 00:10:25,003 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,003 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,003 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. after waiting 0 ms 2023-07-19 00:10:25,003 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,003 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,003 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for feaa797b22f0c98625948f3592412afe: 2023-07-19 00:10:25,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:25,015 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689725425015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725425015"}]},"ts":"1689725425015"} 2023-07-19 00:10:25,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 00:10:25,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:25,023 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:25,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725425023"}]},"ts":"1689725425023"} 2023-07-19 00:10:25,029 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 00:10:25,044 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:25,052 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:25,052 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:25,052 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:25,052 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:25,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=feaa797b22f0c98625948f3592412afe, ASSIGN}] 2023-07-19 00:10:25,064 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=feaa797b22f0c98625948f3592412afe, ASSIGN 2023-07-19 00:10:25,066 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=feaa797b22f0c98625948f3592412afe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:10:25,217 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 00:10:25,218 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=feaa797b22f0c98625948f3592412afe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:25,218 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689725425218"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725425218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725425218"}]},"ts":"1689725425218"} 2023-07-19 00:10:25,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:25,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure feaa797b22f0c98625948f3592412afe, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:10:25,397 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => feaa797b22f0c98625948f3592412afe, NAME => 'hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:25,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. service=AccessControlService 2023-07-19 00:10:25,398 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:25,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:25,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,407 INFO [StoreOpener-feaa797b22f0c98625948f3592412afe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,410 DEBUG [StoreOpener-feaa797b22f0c98625948f3592412afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/l 2023-07-19 00:10:25,410 DEBUG [StoreOpener-feaa797b22f0c98625948f3592412afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/l 2023-07-19 00:10:25,411 INFO [StoreOpener-feaa797b22f0c98625948f3592412afe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feaa797b22f0c98625948f3592412afe columnFamilyName l 2023-07-19 00:10:25,412 INFO [StoreOpener-feaa797b22f0c98625948f3592412afe-1] regionserver.HStore(310): Store=feaa797b22f0c98625948f3592412afe/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:25,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for feaa797b22f0c98625948f3592412afe 2023-07-19 00:10:25,432 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:25,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened feaa797b22f0c98625948f3592412afe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67097483, jitterRate=-1.6959011554718018E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:25,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for feaa797b22f0c98625948f3592412afe: 2023-07-19 00:10:25,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe., pid=11, masterSystemTime=1689725425387 2023-07-19 00:10:25,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,439 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:10:25,441 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=feaa797b22f0c98625948f3592412afe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:25,441 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689725425441"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725425441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725425441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725425441"}]},"ts":"1689725425441"} 2023-07-19 00:10:25,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 00:10:25,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure feaa797b22f0c98625948f3592412afe, server=jenkins-hbase4.apache.org,39975,1689725421095 in 218 msec 2023-07-19 00:10:25,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 00:10:25,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=feaa797b22f0c98625948f3592412afe, ASSIGN in 397 msec 2023-07-19 00:10:25,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:25,456 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725425456"}]},"ts":"1689725425456"} 2023-07-19 00:10:25,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 00:10:25,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:25,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 576 msec 2023-07-19 00:10:25,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:25,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 00:10:25,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 00:10:26,170 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:26,513 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:26,522 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45665_jobhistory____.xuctqb/webapp 2023-07-19 00:10:26,681 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 00:10:26,681 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:26,682 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:26,684 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:26,757 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:27,068 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:27,426 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 00:10:27,468 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45665 2023-07-19 00:10:27,664 WARN [Listener at jenkins-hbase4.apache.org/41171] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:28,119 WARN [Listener at jenkins-hbase4.apache.org/41171] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 00:10:28,120 INFO [Listener at jenkins-hbase4.apache.org/41171] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:28,134 INFO [Listener at jenkins-hbase4.apache.org/41171] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42327_cluster____.34wt92/webapp 2023-07-19 00:10:28,232 INFO [Listener at jenkins-hbase4.apache.org/41171] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:28,232 INFO [Listener at jenkins-hbase4.apache.org/41171] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 00:10:28,233 INFO [Listener at jenkins-hbase4.apache.org/41171] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:28,233 INFO [Listener at jenkins-hbase4.apache.org/41171] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:28,247 INFO [Listener at jenkins-hbase4.apache.org/41171] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:28,540 INFO [Listener at jenkins-hbase4.apache.org/41171] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:28,817 INFO [Listener at jenkins-hbase4.apache.org/41171] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:28,837 INFO [Listener at jenkins-hbase4.apache.org/41171] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42327 2023-07-19 00:10:29,271 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:10:29,422 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 00:10:29,423 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 00:10:29,425 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 00:10:29,657 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:29,658 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 00:10:29,658 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:29,658 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 00:10:29,659 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 00:10:29,659 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 00:10:29,659 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:29,659 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 00:10:29,659 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 00:10:29,659 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 00:10:29,723 WARN [Listener at jenkins-hbase4.apache.org/37313] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:29,756 WARN [Listener at jenkins-hbase4.apache.org/37313] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 00:10:29,756 INFO [Listener at jenkins-hbase4.apache.org/37313] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:29,764 INFO [Listener at jenkins-hbase4.apache.org/37313] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34527_node____.jz1xu1/webapp 2023-07-19 00:10:29,843 INFO [Listener at jenkins-hbase4.apache.org/37313] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 00:10:29,843 INFO [Listener at jenkins-hbase4.apache.org/37313] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:29,845 INFO [Listener at jenkins-hbase4.apache.org/37313] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:29,846 INFO [Listener at jenkins-hbase4.apache.org/37313] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:29,858 INFO [Listener at jenkins-hbase4.apache.org/37313] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:29,894 INFO [Listener at jenkins-hbase4.apache.org/37313] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:29,978 INFO [Listener at jenkins-hbase4.apache.org/37313] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:29,999 INFO [Listener at jenkins-hbase4.apache.org/37313] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34527 2023-07-19 00:10:30,225 WARN [Listener at jenkins-hbase4.apache.org/43275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:30,232 WARN [Listener at jenkins-hbase4.apache.org/43275] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 00:10:30,233 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:30,244 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37619_node____.ssgslk/webapp 2023-07-19 00:10:30,318 INFO [Listener at jenkins-hbase4.apache.org/43275] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 00:10:30,318 INFO [Listener at jenkins-hbase4.apache.org/43275] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:30,319 INFO [Listener at jenkins-hbase4.apache.org/43275] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:30,319 INFO [Listener at jenkins-hbase4.apache.org/43275] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:30,328 INFO [Listener at jenkins-hbase4.apache.org/43275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:30,346 INFO [Listener at jenkins-hbase4.apache.org/43275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:30,416 INFO [Listener at jenkins-hbase4.apache.org/43275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:30,422 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37619 2023-07-19 00:10:30,456 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 00:10:30,458 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:30,520 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=176, AvailableMemoryMB=4471 2023-07-19 00:10:30,521 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-19 00:10:30,536 DEBUG [Listener at jenkins-hbase4.apache.org/43275] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 00:10:30,542 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 00:10:30,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 00:10:30,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:30,557 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:30,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 00:10:30,560 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:30,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:30,567 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:30,567 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:30,570 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca empty. 2023-07-19 00:10:30,570 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 empty. 2023-07-19 00:10:30,571 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:30,572 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:30,572 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 00:10:30,605 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:30,607 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 950c081de8ab4c233ffc33016871f059, NAME => 'testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:10:30,616 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => dbe3aa3936eb8534b7cd6f9a284aafca, NAME => 'testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:10:30,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:30,670 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:30,672 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 950c081de8ab4c233ffc33016871f059, disabling compactions & flushes 2023-07-19 00:10:30,672 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:30,672 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:30,672 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. after waiting 0 ms 2023-07-19 00:10:30,672 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:30,672 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:30,672 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 950c081de8ab4c233ffc33016871f059: 2023-07-19 00:10:30,673 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:30,673 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing dbe3aa3936eb8534b7cd6f9a284aafca, disabling compactions & flushes 2023-07-19 00:10:30,674 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:30,674 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:30,674 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. after waiting 0 ms 2023-07-19 00:10:30,674 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:30,674 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:30,674 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for dbe3aa3936eb8534b7cd6f9a284aafca: 2023-07-19 00:10:30,679 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:30,681 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725430680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725430680"}]},"ts":"1689725430680"} 2023-07-19 00:10:30,681 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725430680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725430680"}]},"ts":"1689725430680"} 2023-07-19 00:10:30,738 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:10:30,740 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:30,740 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725430740"}]},"ts":"1689725430740"} 2023-07-19 00:10:30,743 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 00:10:30,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:30,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:30,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:30,752 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:30,752 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:30,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, ASSIGN}] 2023-07-19 00:10:30,756 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, ASSIGN 2023-07-19 00:10:30,756 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, ASSIGN 2023-07-19 00:10:30,758 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42097,1689725420965; forceNewPlan=false, retain=false 2023-07-19 00:10:30,758 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:10:30,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:30,908 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:10:30,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=950c081de8ab4c233ffc33016871f059, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:30,911 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dbe3aa3936eb8534b7cd6f9a284aafca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:30,911 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725430910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725430910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725430910"}]},"ts":"1689725430910"} 2023-07-19 00:10:30,911 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725430910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725430910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725430910"}]},"ts":"1689725430910"} 2023-07-19 00:10:30,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 950c081de8ab4c233ffc33016871f059, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:10:30,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure dbe3aa3936eb8534b7cd6f9a284aafca, server=jenkins-hbase4.apache.org,42097,1689725420965}] 2023-07-19 00:10:31,071 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,072 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:10:31,078 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:10:31,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:31,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 950c081de8ab4c233ffc33016871f059, NAME => 'testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:10:31,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. service=AccessControlService 2023-07-19 00:10:31,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:31,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:31,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:31,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbe3aa3936eb8534b7cd6f9a284aafca, NAME => 'testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:10:31,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. service=AccessControlService 2023-07-19 00:10:31,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:31,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:31,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,104 INFO [StoreOpener-950c081de8ab4c233ffc33016871f059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,104 INFO [StoreOpener-dbe3aa3936eb8534b7cd6f9a284aafca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,107 DEBUG [StoreOpener-950c081de8ab4c233ffc33016871f059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf 2023-07-19 00:10:31,107 DEBUG [StoreOpener-950c081de8ab4c233ffc33016871f059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf 2023-07-19 00:10:31,107 DEBUG [StoreOpener-dbe3aa3936eb8534b7cd6f9a284aafca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf 2023-07-19 00:10:31,107 DEBUG [StoreOpener-dbe3aa3936eb8534b7cd6f9a284aafca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf 2023-07-19 00:10:31,113 INFO [StoreOpener-950c081de8ab4c233ffc33016871f059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 950c081de8ab4c233ffc33016871f059 columnFamilyName cf 2023-07-19 00:10:31,113 INFO [StoreOpener-dbe3aa3936eb8534b7cd6f9a284aafca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe3aa3936eb8534b7cd6f9a284aafca columnFamilyName cf 2023-07-19 00:10:31,116 INFO [StoreOpener-dbe3aa3936eb8534b7cd6f9a284aafca-1] regionserver.HStore(310): Store=dbe3aa3936eb8534b7cd6f9a284aafca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:31,116 INFO [StoreOpener-950c081de8ab4c233ffc33016871f059-1] regionserver.HStore(310): Store=950c081de8ab4c233ffc33016871f059/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:31,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:31,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:31,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:31,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:31,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbe3aa3936eb8534b7cd6f9a284aafca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61386776, jitterRate=-0.08526575565338135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:31,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbe3aa3936eb8534b7cd6f9a284aafca: 2023-07-19 00:10:31,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 950c081de8ab4c233ffc33016871f059; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60552933, jitterRate=-0.09769098460674286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:31,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 950c081de8ab4c233ffc33016871f059: 2023-07-19 00:10:31,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059., pid=15, masterSystemTime=1689725431068 2023-07-19 00:10:31,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca., pid=16, masterSystemTime=1689725431071 2023-07-19 00:10:31,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:31,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:31,153 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=950c081de8ab4c233ffc33016871f059, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,153 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725431152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725431152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725431152"}]},"ts":"1689725431152"} 2023-07-19 00:10:31,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:31,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:31,155 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dbe3aa3936eb8534b7cd6f9a284aafca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431155"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725431155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725431155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725431155"}]},"ts":"1689725431155"} 2023-07-19 00:10:31,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-19 00:10:31,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 950c081de8ab4c233ffc33016871f059, server=jenkins-hbase4.apache.org,39975,1689725421095 in 244 msec 2023-07-19 00:10:31,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-19 00:10:31,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure dbe3aa3936eb8534b7cd6f9a284aafca, server=jenkins-hbase4.apache.org,42097,1689725420965 in 245 msec 2023-07-19 00:10:31,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, ASSIGN in 411 msec 2023-07-19 00:10:31,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:31,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-19 00:10:31,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, ASSIGN in 417 msec 2023-07-19 00:10:31,175 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:31,175 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725431175"}]},"ts":"1689725431175"} 2023-07-19 00:10:31,177 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 00:10:31,180 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:31,185 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 00:10:31,202 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 00:10:31,234 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,234 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,234 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,234 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,234 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:31,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 694 msec 2023-07-19 00:10:31,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:31,674 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 00:10:31,678 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 00:10:31,680 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:31,682 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:31,715 DEBUG [hconnection-0x78b47ac1-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:31,720 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:31,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:31,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725431736 (current time:1689725431736). 2023-07-19 00:10:31,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:31,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x4b41fc87 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:31,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cc31aaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:31,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:31,750 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:31,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b41fc87 to 127.0.0.1:57509 2023-07-19 00:10:31,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:31,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x364e5806 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:31,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@560937b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:31,765 DEBUG [hconnection-0x61b96257-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:31,769 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:31,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x364e5806 to 127.0.0.1:57509 2023-07-19 00:10:31,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:31,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 00:10:31,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:31,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:31,846 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:31,847 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689726031847 2023-07-19 00:10:31,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:31,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 00:10:31,851 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:31,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:31,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-19 00:10:31,855 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:31,857 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:31,858 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:31,859 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689726031859 2023-07-19 00:10:31,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,907 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 00:10:31,907 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,908 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 00:10:31,908 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 00:10:31,909 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,909 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,915 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,915 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,915 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,915 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,916 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,916 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,917 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,917 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:31,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 00:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 00:10:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 00:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:31,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:31,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,923 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:31,923 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,926 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,927 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:31,931 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,931 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,931 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,932 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2def8310[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:31,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2def8310[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:31,942 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 00:10:31,942 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:31,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,947 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:10:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:31,947 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:31,947 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:31,948 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:31,949 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. started... 2023-07-19 00:10:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:31,950 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:31,950 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. started... 2023-07-19 00:10:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:31,951 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:31,951 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:31,954 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 950c081de8ab4c233ffc33016871f059: 2023-07-19 00:10:31,955 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,956 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbe3aa3936eb8534b7cd6f9a284aafca: 2023-07-19 00:10:31,956 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,958 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:31,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:31,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:31,972 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:31,972 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:31,974 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:31,978 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:31,978 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:32,013 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. completed. 2023-07-19 00:10:32,013 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:10:32,017 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:32,017 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. completed. 2023-07-19 00:10:32,017 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,017 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,017 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:32,017 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:10:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:32,021 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42097,1689725420965': 2023-07-19 00:10:32,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 00:10:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:10:32,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 00:10:32,032 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 00:10:32,032 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:32,032 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:32,032 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,032 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,037 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,038 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,039 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,039 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,042 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,043 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,043 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,056 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,057 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,057 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 00:10:32,057 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,057 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:10:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,057 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,058 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,059 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:32,059 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,059 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,059 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 00:10:32,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,172 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:32,174 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:10:32,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 00:10:32,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,209 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689725431849Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689725432079 (+230 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689725432079Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689725432080 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689725432096 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689725432123 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689725432208 (+85 ms) 2023-07-19 00:10:32,211 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 359 msec 2023-07-19 00:10:32,474 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:32,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:32,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42097] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:32,500 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 00:10:32,500 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:32,500 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:32,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:32,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725432519 (current time:1689725432519). 2023-07-19 00:10:32,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:32,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x77dd7e36 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:32,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d684e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:32,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:32,531 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:32,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77dd7e36 to 127.0.0.1:57509 2023-07-19 00:10:32,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:32,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x2f5fb840 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:32,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@336f5f53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:32,542 DEBUG [hconnection-0x47ea1c6c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:32,546 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:32,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f5fb840 to 127.0.0.1:57509 2023-07-19 00:10:32,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:32,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 00:10:32,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:32,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:32,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:32,560 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:32,562 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689726032562 2023-07-19 00:10:32,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:32,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 00:10:32,564 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:32,564 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:32,566 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:32,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-19 00:10:32,569 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,571 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689726032571 2023-07-19 00:10:32,664 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:32,666 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:32,867 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:32,868 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:10:32,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 00:10:32,993 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 00:10:32,993 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:32,993 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 00:10:32,993 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 00:10:32,994 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,994 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,995 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,995 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,996 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,995 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,997 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:32,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,997 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,998 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:32,998 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 00:10:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 00:10:32,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:32,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:32,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 00:10:33,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 00:10:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:33,003 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:33,003 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:33,003 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:33,006 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,006 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:33,007 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:33,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:33,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f72d3c9[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:33,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:33,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:33,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f72d3c9[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:33,014 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 00:10:33,014 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:33,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,019 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:33,020 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:33,020 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. started... 2023-07-19 00:10:33,020 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,020 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,020 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. started... 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:33,020 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dbe3aa3936eb8534b7cd6f9a284aafca 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 00:10:33,020 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 950c081de8ab4c233ffc33016871f059 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 00:10:33,020 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:33,020 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:10:33,023 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:33,023 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:33,023 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:33,168 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:33,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:33,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:33,170 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:10:33,174 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071929bae0be343344da9440b45478bdae92 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071929bae0be343344da9440b45478bdae92 2023-07-19 00:10:33,174 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719ca8796517b6c420da16f9464d5390baa to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719ca8796517b6c420da16f9464d5390baa 2023-07-19 00:10:33,221 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/.tmp/cf/418449efac1e4abeb2912ee9c4feeb1c 2023-07-19 00:10:33,227 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/.tmp/cf/adca9f7111de4cdbb27948e17c465a08 2023-07-19 00:10:33,241 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/.tmp/cf/418449efac1e4abeb2912ee9c4feeb1c as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf/418449efac1e4abeb2912ee9c4feeb1c 2023-07-19 00:10:33,241 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/.tmp/cf/adca9f7111de4cdbb27948e17c465a08 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf/adca9f7111de4cdbb27948e17c465a08 2023-07-19 00:10:33,251 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf/adca9f7111de4cdbb27948e17c465a08, entries=48, sequenceid=6, filesize=13.0 K 2023-07-19 00:10:33,251 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf/418449efac1e4abeb2912ee9c4feeb1c, entries=2, sequenceid=6, filesize=5.2 K 2023-07-19 00:10:33,256 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 950c081de8ab4c233ffc33016871f059 in 236ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:33,256 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for dbe3aa3936eb8534b7cd6f9a284aafca in 236ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:33,257 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 00:10:33,257 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 00:10:33,259 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 950c081de8ab4c233ffc33016871f059: 2023-07-19 00:10:33,259 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:33,259 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:33,260 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf/418449efac1e4abeb2912ee9c4feeb1c] hfiles 2023-07-19 00:10:33,260 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf/418449efac1e4abeb2912ee9c4feeb1c for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:33,264 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbe3aa3936eb8534b7cd6f9a284aafca: 2023-07-19 00:10:33,264 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:33,264 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:33,264 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf/adca9f7111de4cdbb27948e17c465a08] hfiles 2023-07-19 00:10:33,264 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf/adca9f7111de4cdbb27948e17c465a08 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:33,310 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. completed. 2023-07-19 00:10:33,310 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:33,311 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:33,311 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:33,311 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,311 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:33,311 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:10:33,313 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:33,313 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,313 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:33,313 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:10:33,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 00:10:33,671 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:33,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:33,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:33,673 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-19 00:10:33,710 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. completed. 2023-07-19 00:10:33,710 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:10:33,713 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:33,713 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,713 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:33,713 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:33,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:33,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:33,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:33,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:33,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42097,1689725420965': 2023-07-19 00:10:33,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 00:10:33,728 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 00:10:33,728 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:33,728 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:33,728 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 00:10:33,728 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:33,731 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,731 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:33,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,731 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,732 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:33,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,731 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:33,731 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,732 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:33,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:33,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:33,733 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:33,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:33,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,740 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:33,743 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,751 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,752 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,752 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,772 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:33,772 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:33,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:33,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:33,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:33,772 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:33,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:33,773 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:33,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 00:10:33,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:33,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 00:10:33,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:33,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:10:33,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:33,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:33,777 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,779 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:33,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719ca8796517b6c420da16f9464d5390baa, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071929bae0be343344da9440b45478bdae92] mob files 2023-07-19 00:10:33,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719ca8796517b6c420da16f9464d5390baa 2023-07-19 00:10:33,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071929bae0be343344da9440b45478bdae92 2023-07-19 00:10:33,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:33,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 00:10:33,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 00:10:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,929 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 00:10:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689725432563Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689725433809 (+1246 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689725433809Loading Region manifests for snaptb0-testExportWithTargetName at 1689725433809Writing data manifest for snaptb0-testExportWithTargetName at 1689725433831 (+22 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689725433853 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689725433928 (+75 ms) 2023-07-19 00:10:33,932 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:33,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3680 sec 2023-07-19 00:10:34,674 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:34,678 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678 2023-07-19 00:10:34,679 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40831, tgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678, rawTgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:34,737 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:34,738 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-894036791_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 00:10:34,738 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 00:10:34,761 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 00:10:34,830 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,830 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,831 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,831 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,831 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,832 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,832 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,918 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-6597916175415120114.jar 2023-07-19 00:10:34,919 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,919 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,920 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,920 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,921 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,921 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:34,922 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:10:34,922 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:10:34,922 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:10:34,923 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:10:34,923 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:10:34,924 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:10:34,924 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:10:34,925 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:10:34,925 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:10:34,926 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:10:34,929 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:34,929 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:34,929 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:34,930 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:34,930 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:34,930 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:34,931 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:36,185 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:10:36,193 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 00:10:36,203 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 00:10:36,612 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:10:36,757 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:36,758 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:37,279 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:42,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:44,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:50,131 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:10:50,134 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:10:50,183 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 00:10:50,183 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:10:50,188 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:10:50,188 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 00:10:50,189 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 00:10:50,189 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 00:10:50,189 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678/.hbase-snapshot/testExportWithTargetName 2023-07-19 00:10:50,189 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 00:10:50,190 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725434678/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 00:10:50,203 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 00:10:50,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 00:10:50,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,221 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725450221"}]},"ts":"1689725450221"} 2023-07-19 00:10:50,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 00:10:50,222 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 00:10:50,257 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 00:10:50,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, UNASSIGN}] 2023-07-19 00:10:50,262 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, UNASSIGN 2023-07-19 00:10:50,263 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, UNASSIGN 2023-07-19 00:10:50,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dbe3aa3936eb8534b7cd6f9a284aafca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:50,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=950c081de8ab4c233ffc33016871f059, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:50,264 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725450264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725450264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725450264"}]},"ts":"1689725450264"} 2023-07-19 00:10:50,264 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725450264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725450264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725450264"}]},"ts":"1689725450264"} 2023-07-19 00:10:50,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure dbe3aa3936eb8534b7cd6f9a284aafca, server=jenkins-hbase4.apache.org,42097,1689725420965}] 2023-07-19 00:10:50,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 950c081de8ab4c233ffc33016871f059, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:10:50,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 00:10:50,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:50,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:50,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbe3aa3936eb8534b7cd6f9a284aafca, disabling compactions & flushes 2023-07-19 00:10:50,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 950c081de8ab4c233ffc33016871f059, disabling compactions & flushes 2023-07-19 00:10:50,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:50,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:50,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:50,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:50,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. after waiting 0 ms 2023-07-19 00:10:50,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. after waiting 0 ms 2023-07-19 00:10:50,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:50,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:50,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:10:50,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:10:50,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:50,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059. 2023-07-19 00:10:50,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 950c081de8ab4c233ffc33016871f059: 2023-07-19 00:10:50,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:50,450 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=950c081de8ab4c233ffc33016871f059, regionState=CLOSED 2023-07-19 00:10:50,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725450450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725450450"}]},"ts":"1689725450450"} 2023-07-19 00:10:50,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:50,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca. 2023-07-19 00:10:50,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbe3aa3936eb8534b7cd6f9a284aafca: 2023-07-19 00:10:50,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:50,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 00:10:50,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dbe3aa3936eb8534b7cd6f9a284aafca, regionState=CLOSED 2023-07-19 00:10:50,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 950c081de8ab4c233ffc33016871f059, server=jenkins-hbase4.apache.org,39975,1689725421095 in 186 msec 2023-07-19 00:10:50,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725450457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725450457"}]},"ts":"1689725450457"} 2023-07-19 00:10:50,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=950c081de8ab4c233ffc33016871f059, UNASSIGN in 197 msec 2023-07-19 00:10:50,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 00:10:50,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure dbe3aa3936eb8534b7cd6f9a284aafca, server=jenkins-hbase4.apache.org,42097,1689725420965 in 193 msec 2023-07-19 00:10:50,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-19 00:10:50,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbe3aa3936eb8534b7cd6f9a284aafca, UNASSIGN in 201 msec 2023-07-19 00:10:50,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725450465"}]},"ts":"1689725450465"} 2023-07-19 00:10:50,466 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 00:10:50,519 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 00:10:50,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 310 msec 2023-07-19 00:10:50,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 00:10:50,524 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 00:10:50,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 00:10:50,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,538 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 00:10:50,540 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,544 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 00:10:50,546 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:50,546 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:50,550 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/recovered.edits] 2023-07-19 00:10:50,550 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/recovered.edits] 2023-07-19 00:10:50,558 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf/adca9f7111de4cdbb27948e17c465a08 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/cf/adca9f7111de4cdbb27948e17c465a08 2023-07-19 00:10:50,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf/418449efac1e4abeb2912ee9c4feeb1c to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/cf/418449efac1e4abeb2912ee9c4feeb1c 2023-07-19 00:10:50,562 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca/recovered.edits/9.seqid 2023-07-19 00:10:50,562 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059/recovered.edits/9.seqid 2023-07-19 00:10:50,563 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/dbe3aa3936eb8534b7cd6f9a284aafca 2023-07-19 00:10:50,563 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportWithTargetName/950c081de8ab4c233ffc33016871f059 2023-07-19 00:10:50,563 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 00:10:50,564 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 00:10:50,565 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-19 00:10:50,569 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719ca8796517b6c420da16f9464d5390baa to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719ca8796517b6c420da16f9464d5390baa 2023-07-19 00:10:50,570 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071929bae0be343344da9440b45478bdae92 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071929bae0be343344da9440b45478bdae92 2023-07-19 00:10:50,570 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 00:10:50,574 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,594 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 00:10:50,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:50,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:50,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:50,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:50,684 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 00:10:50,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 00:10:50,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725450686"}]},"ts":"9223372036854775807"} 2023-07-19 00:10:50,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725450686"}]},"ts":"9223372036854775807"} 2023-07-19 00:10:50,688 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:10:50,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 950c081de8ab4c233ffc33016871f059, NAME => 'testtb-testExportWithTargetName,,1689725430550.950c081de8ab4c233ffc33016871f059.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dbe3aa3936eb8534b7cd6f9a284aafca, NAME => 'testtb-testExportWithTargetName,1,1689725430550.dbe3aa3936eb8534b7cd6f9a284aafca.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:10:50,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 00:10:50,689 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725450689"}]},"ts":"9223372036854775807"} 2023-07-19 00:10:50,690 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 00:10:50,749 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:50,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 00:10:50,749 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:50,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 00:10:50,750 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:50,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 00:10:50,750 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:10:50,749 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:50,750 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:10:50,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 00:10:50,750 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:10:50,750 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:10:50,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 00:10:50,797 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:50,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 267 msec 2023-07-19 00:10:50,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 00:10:50,855 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 00:10:50,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 00:10:50,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:50,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 00:10:50,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 00:10:50,911 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 705) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1599172513_1 at /127.0.0.1:54214 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:34585 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:33699 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:43275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:45854 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-894036791_17 at /127.0.0.1:44386 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:54240 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2655 (was 4471) 2023-07-19 00:10:50,911 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-19 00:10:50,931 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=183, AvailableMemoryMB=2654 2023-07-19 00:10:50,931 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-19 00:10:50,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 00:10:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:10:50,938 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:50,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 00:10:50,941 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:50,944 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:50,944 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 2023-07-19 00:10:50,944 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 empty. 2023-07-19 00:10:50,944 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 empty. 2023-07-19 00:10:50,945 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:50,945 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 2023-07-19 00:10:50,945 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 00:10:50,960 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:50,961 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 895521ad6577cb5c4f4f908a5ec45d15, NAME => 'testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:10:50,961 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e50862249119460cbded056612db5cc8, NAME => 'testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:10:50,977 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:50,977 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e50862249119460cbded056612db5cc8, disabling compactions & flushes 2023-07-19 00:10:50,977 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:50,977 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:50,977 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. after waiting 0 ms 2023-07-19 00:10:50,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:50,978 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:50,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:50,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e50862249119460cbded056612db5cc8: 2023-07-19 00:10:50,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 895521ad6577cb5c4f4f908a5ec45d15, disabling compactions & flushes 2023-07-19 00:10:50,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:50,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:50,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. after waiting 0 ms 2023-07-19 00:10:50,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:50,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:50,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 895521ad6577cb5c4f4f908a5ec45d15: 2023-07-19 00:10:50,982 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:50,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725450983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725450983"}]},"ts":"1689725450983"} 2023-07-19 00:10:50,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725450983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725450983"}]},"ts":"1689725450983"} 2023-07-19 00:10:50,986 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:10:50,987 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:50,988 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725450988"}]},"ts":"1689725450988"} 2023-07-19 00:10:50,990 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 00:10:51,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:51,111 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:51,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:51,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:51,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:51,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:51,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, ASSIGN}] 2023-07-19 00:10:51,116 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, ASSIGN 2023-07-19 00:10:51,116 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, ASSIGN 2023-07-19 00:10:51,118 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:10:51,118 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1689725421035; forceNewPlan=false, retain=false 2023-07-19 00:10:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:51,268 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:10:51,271 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e50862249119460cbded056612db5cc8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:51,271 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=895521ad6577cb5c4f4f908a5ec45d15, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:51,271 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725451270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725451270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725451270"}]},"ts":"1689725451270"} 2023-07-19 00:10:51,271 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725451271"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725451271"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725451271"}]},"ts":"1689725451271"} 2023-07-19 00:10:51,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e50862249119460cbded056612db5cc8, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:10:51,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 895521ad6577cb5c4f4f908a5ec45d15, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:10:51,427 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:51,427 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:10:51,432 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:10:51,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:51,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 895521ad6577cb5c4f4f908a5ec45d15, NAME => 'testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:10:51,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. service=AccessControlService 2023-07-19 00:10:51,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,439 INFO [StoreOpener-895521ad6577cb5c4f4f908a5ec45d15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:51,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e50862249119460cbded056612db5cc8, NAME => 'testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:10:51,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. service=AccessControlService 2023-07-19 00:10:51,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:51,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:51,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,441 DEBUG [StoreOpener-895521ad6577cb5c4f4f908a5ec45d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf 2023-07-19 00:10:51,441 DEBUG [StoreOpener-895521ad6577cb5c4f4f908a5ec45d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf 2023-07-19 00:10:51,442 INFO [StoreOpener-895521ad6577cb5c4f4f908a5ec45d15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 895521ad6577cb5c4f4f908a5ec45d15 columnFamilyName cf 2023-07-19 00:10:51,443 INFO [StoreOpener-e50862249119460cbded056612db5cc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,443 INFO [StoreOpener-895521ad6577cb5c4f4f908a5ec45d15-1] regionserver.HStore(310): Store=895521ad6577cb5c4f4f908a5ec45d15/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:51,445 DEBUG [StoreOpener-e50862249119460cbded056612db5cc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf 2023-07-19 00:10:51,445 DEBUG [StoreOpener-e50862249119460cbded056612db5cc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf 2023-07-19 00:10:51,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,445 INFO [StoreOpener-e50862249119460cbded056612db5cc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e50862249119460cbded056612db5cc8 columnFamilyName cf 2023-07-19 00:10:51,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,447 INFO [StoreOpener-e50862249119460cbded056612db5cc8-1] regionserver.HStore(310): Store=e50862249119460cbded056612db5cc8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:51,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:10:51,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:51,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e50862249119460cbded056612db5cc8 2023-07-19 00:10:51,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 895521ad6577cb5c4f4f908a5ec45d15; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70649302, jitterRate=0.05275663733482361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:51,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 895521ad6577cb5c4f4f908a5ec45d15: 2023-07-19 00:10:51,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15., pid=31, masterSystemTime=1689725451427 2023-07-19 00:10:51,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:51,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e50862249119460cbded056612db5cc8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69321696, jitterRate=0.0329737663269043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:51,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e50862249119460cbded056612db5cc8: 2023-07-19 00:10:51,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:51,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:51,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8., pid=30, masterSystemTime=1689725451427 2023-07-19 00:10:51,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=895521ad6577cb5c4f4f908a5ec45d15, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:51,461 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725451461"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725451461"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725451461"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725451461"}]},"ts":"1689725451461"} 2023-07-19 00:10:51,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:51,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:51,464 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e50862249119460cbded056612db5cc8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:51,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725451464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725451464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725451464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725451464"}]},"ts":"1689725451464"} 2023-07-19 00:10:51,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 00:10:51,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 895521ad6577cb5c4f4f908a5ec45d15, server=jenkins-hbase4.apache.org,39975,1689725421095 in 191 msec 2023-07-19 00:10:51,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 00:10:51,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e50862249119460cbded056612db5cc8, server=jenkins-hbase4.apache.org,43375,1689725421035 in 194 msec 2023-07-19 00:10:51,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, ASSIGN in 355 msec 2023-07-19 00:10:51,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 00:10:51,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, ASSIGN in 359 msec 2023-07-19 00:10:51,475 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:51,475 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725451475"}]},"ts":"1689725451475"} 2023-07-19 00:10:51,477 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 00:10:51,529 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:51,529 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 00:10:51,531 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:10:51,542 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:51,542 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:51,542 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:51,542 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:51,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:51,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:51,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 661 msec 2023-07-19 00:10:52,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:52,046 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 00:10:52,049 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 00:10:52,049 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:52,051 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:52,061 DEBUG [hconnection-0x78b47ac1-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:52,066 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:52,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:52,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725452071 (current time:1689725452071). 2023-07-19 00:10:52,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:52,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x11ed467a to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:52,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ab7a9ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:52,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:52,080 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:52,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11ed467a to 127.0.0.1:57509 2023-07-19 00:10:52,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:52,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x3e450275 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:52,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e04d51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:52,093 DEBUG [hconnection-0x227dc62e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:52,096 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e450275 to 127.0.0.1:57509 2023-07-19 00:10:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:10:52,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:52,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:52,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:52,108 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:52,109 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726052109 2023-07-19 00:10:52,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:52,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 00:10:52,118 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:52,118 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:52,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:52,120 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:52,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-19 00:10:52,123 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:52,125 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726052125 2023-07-19 00:10:52,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,141 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 00:10:52,141 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,143 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 00:10:52,143 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:10:52,143 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,144 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,145 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,145 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,145 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,145 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,146 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,146 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,147 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:52,147 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:52,147 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,149 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:52,149 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:52,149 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,147 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,150 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:52,149 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,159 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,159 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,160 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,160 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:52,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60055fc0[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:52,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60055fc0[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:52,164 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:10:52,165 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:52,166 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,166 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:52,166 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,167 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:52,167 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:52,167 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:52,167 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. started... 2023-07-19 00:10:52,167 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. started... 2023-07-19 00:10:52,166 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e50862249119460cbded056612db5cc8: 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 895521ad6577cb5c4f4f908a5ec45d15: 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:52,168 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:52,169 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:52,170 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:52,170 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,170 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:52,190 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. completed. 2023-07-19 00:10:52,190 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:52,190 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,191 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. completed. 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:52,191 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:10:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:52,198 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:52,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,198 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:52,199 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:10:52,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:10:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:10:52,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:10:52,208 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 00:10:52,208 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:52,208 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:52,208 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,208 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:52,210 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,210 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,210 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,210 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,211 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,211 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,212 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,212 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,215 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,215 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,215 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,218 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,218 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,218 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,218 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,218 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:52,219 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,218 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,219 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,219 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,218 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 00:10:52,220 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,221 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,221 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:10:52,221 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:52,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:52,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,221 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,222 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:52,222 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,222 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,222 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,222 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 00:10:52,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 00:10:52,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,293 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:52,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689725452109Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689725452233 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689725452233Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689725452233Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689725452238 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689725452253 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689725452293 (+40 ms) 2023-07-19 00:10:52,296 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:52,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 185 msec 2023-07-19 00:10:52,422 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:52,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:52,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:52,441 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 00:10:52,442 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:52,442 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:52,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:52,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725452455 (current time:1689725452455). 2023-07-19 00:10:52,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:52,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x3d7a1ab0 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:52,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276b7974, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:52,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:52,466 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:52,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d7a1ab0 to 127.0.0.1:57509 2023-07-19 00:10:52,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:52,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x0ac1368f to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:52,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bdf77b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:52,478 DEBUG [hconnection-0x580b04ff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:52,481 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ac1368f to 127.0.0.1:57509 2023-07-19 00:10:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:10:52,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:52,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:52,492 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:52,493 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726052493 2023-07-19 00:10:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:52,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 00:10:52,495 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:52,495 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:52,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:52,499 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:52,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-19 00:10:52,502 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:52,503 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726052503 2023-07-19 00:10:52,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 00:10:52,515 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 00:10:52,515 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,516 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 00:10:52,516 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:10:52,517 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,517 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,518 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,518 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,518 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,518 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,519 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,519 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,520 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:52,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 00:10:52,520 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,521 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:52,522 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:52,522 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:52,522 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 00:10:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:52,522 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:52,526 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,527 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,527 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,527 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:52,527 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,527 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,527 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31a3b7d3[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:52,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31a3b7d3[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:52,532 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:10:52,532 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,533 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:10:52,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,534 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:52,534 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:52,534 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:52,534 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. started... 2023-07-19 00:10:52,534 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:52,535 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. started... 2023-07-19 00:10:52,535 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 895521ad6577cb5c4f4f908a5ec45d15 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 00:10:52,535 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e50862249119460cbded056612db5cc8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 00:10:52,535 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:52,535 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,535 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:52,572 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307191aadfd95c75e40c9993467c86c92288b to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307191aadfd95c75e40c9993467c86c92288b 2023-07-19 00:10:52,573 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719c744fa3a39b04d85bd95a3bbf5790bdb to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230719c744fa3a39b04d85bd95a3bbf5790bdb 2023-07-19 00:10:52,595 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:52,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:52,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:52,597 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:52,598 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/.tmp/cf/fdebe2886cb74ff9898d60a67cf89af2 2023-07-19 00:10:52,599 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/.tmp/cf/f91d78b0e53c4e46939f8183f3e428e2 2023-07-19 00:10:52,608 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/.tmp/cf/fdebe2886cb74ff9898d60a67cf89af2 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf/fdebe2886cb74ff9898d60a67cf89af2 2023-07-19 00:10:52,609 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/.tmp/cf/f91d78b0e53c4e46939f8183f3e428e2 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf/f91d78b0e53c4e46939f8183f3e428e2 2023-07-19 00:10:52,617 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf/f91d78b0e53c4e46939f8183f3e428e2, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 00:10:52,618 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 895521ad6577cb5c4f4f908a5ec45d15 in 83ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:52,618 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 00:10:52,618 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 895521ad6577cb5c4f4f908a5ec45d15: 2023-07-19 00:10:52,619 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:52,619 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:52,619 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf/f91d78b0e53c4e46939f8183f3e428e2] hfiles 2023-07-19 00:10:52,619 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf/f91d78b0e53c4e46939f8183f3e428e2 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:52,629 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf/fdebe2886cb74ff9898d60a67cf89af2, entries=46, sequenceid=6, filesize=12.7 K 2023-07-19 00:10:52,631 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e50862249119460cbded056612db5cc8 in 96ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:52,633 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e50862249119460cbded056612db5cc8: 2023-07-19 00:10:52,633 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:52,633 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:52,633 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf/fdebe2886cb74ff9898d60a67cf89af2] hfiles 2023-07-19 00:10:52,633 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf/fdebe2886cb74ff9898d60a67cf89af2 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:52,637 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. completed. 2023-07-19 00:10:52,637 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:10:52,637 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:52,637 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:52,637 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,637 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:52,637 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:10:52,645 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:52,645 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,645 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:52,655 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,661 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. completed. 2023-07-19 00:10:52,661 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:10:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:10:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,663 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:10:52,663 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:52,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:10:52,663 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,663 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:52,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:10:52,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:10:52,671 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 00:10:52,671 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:52,671 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:52,671 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 00:10:52,671 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:52,674 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,673 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,674 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,675 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,679 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:52,679 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:52,680 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:52,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:52,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,684 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:52,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-19 00:10:52,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 00:10:52,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 00:10:52,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:52,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:52,685 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:10:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:52,685 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:10:52,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:10:52,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:10:52,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,686 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307191aadfd95c75e40c9993467c86c92288b, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230719c744fa3a39b04d85bd95a3bbf5790bdb] mob files 2023-07-19 00:10:52,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307191aadfd95c75e40c9993467c86c92288b 2023-07-19 00:10:52,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230719c744fa3a39b04d85bd95a3bbf5790bdb 2023-07-19 00:10:52,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 00:10:52,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 00:10:52,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,753 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689725452493Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689725452698 (+205 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689725452698Loading Region manifests for snaptb0-testExportFileSystemState at 1689725452699 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689725452703 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689725452720 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689725452752 (+32 ms) 2023-07-19 00:10:52,756 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:52,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 262 msec 2023-07-19 00:10:52,797 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:52,799 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799 2023-07-19 00:10:52,799 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40831, tgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799, rawTgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:52,827 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:10:52,827 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-466626569_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,828 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 00:10:52,843 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:52,879 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,880 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,881 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,881 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,882 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,882 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,883 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,977 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-335306838378973796.jar 2023-07-19 00:10:52,978 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,978 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,979 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,979 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,979 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,980 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:52,980 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:10:52,981 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:10:52,981 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:10:52,981 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:10:52,982 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:10:52,982 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:10:52,983 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:10:52,983 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:10:52,984 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:10:52,985 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:10:52,985 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:52,986 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:52,988 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:52,989 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:54,014 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:10:54,017 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 00:10:54,019 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 00:10:54,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:54,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:54,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:55,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0002_000001 (auth:SIMPLE) 2023-07-19 00:10:56,059 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:10:59,548 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:01,804 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:05,168 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:06,297 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:06,301 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:06,341 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 00:11:06,341 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:06,342 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:06,342 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 00:11:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 00:11:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 00:11:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 00:11:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 00:11:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725452799/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 00:11:06,357 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 00:11:06,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 00:11:06,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 00:11:06,366 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725466366"}]},"ts":"1689725466366"} 2023-07-19 00:11:06,368 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 00:11:06,371 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 00:11:06,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, UNASSIGN}] 2023-07-19 00:11:06,374 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, UNASSIGN 2023-07-19 00:11:06,376 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, UNASSIGN 2023-07-19 00:11:06,377 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e50862249119460cbded056612db5cc8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:06,377 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725466377"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725466377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725466377"}]},"ts":"1689725466377"} 2023-07-19 00:11:06,379 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=895521ad6577cb5c4f4f908a5ec45d15, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:06,379 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725466378"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725466378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725466378"}]},"ts":"1689725466378"} 2023-07-19 00:11:06,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e50862249119460cbded056612db5cc8, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:06,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 895521ad6577cb5c4f4f908a5ec45d15, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:11:06,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 00:11:06,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e50862249119460cbded056612db5cc8 2023-07-19 00:11:06,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e50862249119460cbded056612db5cc8, disabling compactions & flushes 2023-07-19 00:11:06,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:11:06,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:11:06,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. after waiting 0 ms 2023-07-19 00:11:06,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:11:06,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:11:06,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 895521ad6577cb5c4f4f908a5ec45d15, disabling compactions & flushes 2023-07-19 00:11:06,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:11:06,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:11:06,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. after waiting 0 ms 2023-07-19 00:11:06,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:11:06,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:06,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:06,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:06,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:06,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15. 2023-07-19 00:11:06,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8. 2023-07-19 00:11:06,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 895521ad6577cb5c4f4f908a5ec45d15: 2023-07-19 00:11:06,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e50862249119460cbded056612db5cc8: 2023-07-19 00:11:06,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:11:06,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=895521ad6577cb5c4f4f908a5ec45d15, regionState=CLOSED 2023-07-19 00:11:06,554 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725466554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725466554"}]},"ts":"1689725466554"} 2023-07-19 00:11:06,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e50862249119460cbded056612db5cc8 2023-07-19 00:11:06,555 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e50862249119460cbded056612db5cc8, regionState=CLOSED 2023-07-19 00:11:06,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725466555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725466555"}]},"ts":"1689725466555"} 2023-07-19 00:11:06,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-19 00:11:06,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-19 00:11:06,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 895521ad6577cb5c4f4f908a5ec45d15, server=jenkins-hbase4.apache.org,39975,1689725421095 in 174 msec 2023-07-19 00:11:06,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e50862249119460cbded056612db5cc8, server=jenkins-hbase4.apache.org,43375,1689725421035 in 177 msec 2023-07-19 00:11:06,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e50862249119460cbded056612db5cc8, UNASSIGN in 188 msec 2023-07-19 00:11:06,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-19 00:11:06,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=895521ad6577cb5c4f4f908a5ec45d15, UNASSIGN in 188 msec 2023-07-19 00:11:06,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725466563"}]},"ts":"1689725466563"} 2023-07-19 00:11:06,565 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 00:11:06,567 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 00:11:06,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 209 msec 2023-07-19 00:11:06,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 00:11:06,668 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 00:11:06,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 00:11:06,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 00:11:06,675 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,676 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 00:11:06,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,681 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,681 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:11:06,681 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 2023-07-19 00:11:06,680 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:06,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:06,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:06,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:06,683 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:06,684 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/recovered.edits] 2023-07-19 00:11:06,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 00:11:06,685 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/recovered.edits] 2023-07-19 00:11:06,689 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf/f91d78b0e53c4e46939f8183f3e428e2 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/cf/f91d78b0e53c4e46939f8183f3e428e2 2023-07-19 00:11:06,689 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf/fdebe2886cb74ff9898d60a67cf89af2 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/cf/fdebe2886cb74ff9898d60a67cf89af2 2023-07-19 00:11:06,692 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15/recovered.edits/9.seqid 2023-07-19 00:11:06,693 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8/recovered.edits/9.seqid 2023-07-19 00:11:06,693 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/895521ad6577cb5c4f4f908a5ec45d15 2023-07-19 00:11:06,694 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemState/e50862249119460cbded056612db5cc8 2023-07-19 00:11:06,694 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 00:11:06,694 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 00:11:06,695 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-19 00:11:06,699 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307191aadfd95c75e40c9993467c86c92288b to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307191aadfd95c75e40c9993467c86c92288b 2023-07-19 00:11:06,701 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230719c744fa3a39b04d85bd95a3bbf5790bdb to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230719c744fa3a39b04d85bd95a3bbf5790bdb 2023-07-19 00:11:06,701 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 00:11:06,704 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,707 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 00:11:06,715 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 00:11:06,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 00:11:06,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725466716"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:06,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725466716"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:06,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:11:06,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 895521ad6577cb5c4f4f908a5ec45d15, NAME => 'testtb-testExportFileSystemState,,1689725450933.895521ad6577cb5c4f4f908a5ec45d15.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e50862249119460cbded056612db5cc8, NAME => 'testtb-testExportFileSystemState,1,1689725450933.e50862249119460cbded056612db5cc8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:11:06,719 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 00:11:06,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725466719"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:06,721 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 00:11:06,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:06,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 53 msec 2023-07-19 00:11:06,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 00:11:06,785 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 00:11:06,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 00:11:06,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 00:11:06,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 00:11:06,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 00:11:06,827 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 754) Potentially hanging thread: Thread-2141 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:40194 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_611175873_1 at /127.0.0.1:40172 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:35971 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:34438 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:37313 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:42992 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 931) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=581 (was 370) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2544 (was 2654) 2023-07-19 00:11:06,828 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-19 00:11:06,848 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=581, ProcessCount=183, AvailableMemoryMB=2544 2023-07-19 00:11:06,848 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-19 00:11:06,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 00:11:06,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:06,855 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:06,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 00:11:06,856 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:06,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:06,858 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:06,858 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:06,859 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 empty. 2023-07-19 00:11:06,859 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d empty. 2023-07-19 00:11:06,859 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:06,859 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:06,860 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 00:11:06,871 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:06,873 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6253c3daf7ac4e2e0f6cb3ccecb0c00d, NAME => 'testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:11:06,873 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 520a5627a806fbbf12f51b5fc605efc4, NAME => 'testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:11:06,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:06,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 520a5627a806fbbf12f51b5fc605efc4, disabling compactions & flushes 2023-07-19 00:11:06,886 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:06,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:06,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. after waiting 0 ms 2023-07-19 00:11:06,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:06,886 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:06,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 520a5627a806fbbf12f51b5fc605efc4: 2023-07-19 00:11:06,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:07,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:07,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:07,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6253c3daf7ac4e2e0f6cb3ccecb0c00d, disabling compactions & flushes 2023-07-19 00:11:07,287 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. after waiting 0 ms 2023-07-19 00:11:07,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,287 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,287 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6253c3daf7ac4e2e0f6cb3ccecb0c00d: 2023-07-19 00:11:07,290 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:07,291 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725467291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725467291"}]},"ts":"1689725467291"} 2023-07-19 00:11:07,291 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725467291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725467291"}]},"ts":"1689725467291"} 2023-07-19 00:11:07,293 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:07,295 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:07,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725467295"}]},"ts":"1689725467295"} 2023-07-19 00:11:07,296 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 00:11:07,299 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:07,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:07,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:07,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:07,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:07,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, ASSIGN}] 2023-07-19 00:11:07,303 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, ASSIGN 2023-07-19 00:11:07,303 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, ASSIGN 2023-07-19 00:11:07,304 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1689725421035; forceNewPlan=false, retain=false 2023-07-19 00:11:07,304 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:11:07,454 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:07,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=520a5627a806fbbf12f51b5fc605efc4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:07,457 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6253c3daf7ac4e2e0f6cb3ccecb0c00d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:07,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725467457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725467457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725467457"}]},"ts":"1689725467457"} 2023-07-19 00:11:07,457 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725467457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725467457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725467457"}]},"ts":"1689725467457"} 2023-07-19 00:11:07,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 520a5627a806fbbf12f51b5fc605efc4, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:07,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:07,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 6253c3daf7ac4e2e0f6cb3ccecb0c00d, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:11:07,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:07,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 520a5627a806fbbf12f51b5fc605efc4, NAME => 'testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:11:07,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. service=AccessControlService 2023-07-19 00:11:07,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6253c3daf7ac4e2e0f6cb3ccecb0c00d, NAME => 'testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:11:07,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:07,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. service=AccessControlService 2023-07-19 00:11:07,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,617 INFO [StoreOpener-520a5627a806fbbf12f51b5fc605efc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,617 INFO [StoreOpener-6253c3daf7ac4e2e0f6cb3ccecb0c00d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,618 DEBUG [StoreOpener-6253c3daf7ac4e2e0f6cb3ccecb0c00d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf 2023-07-19 00:11:07,618 DEBUG [StoreOpener-6253c3daf7ac4e2e0f6cb3ccecb0c00d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf 2023-07-19 00:11:07,618 DEBUG [StoreOpener-520a5627a806fbbf12f51b5fc605efc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf 2023-07-19 00:11:07,619 DEBUG [StoreOpener-520a5627a806fbbf12f51b5fc605efc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf 2023-07-19 00:11:07,619 INFO [StoreOpener-6253c3daf7ac4e2e0f6cb3ccecb0c00d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6253c3daf7ac4e2e0f6cb3ccecb0c00d columnFamilyName cf 2023-07-19 00:11:07,619 INFO [StoreOpener-520a5627a806fbbf12f51b5fc605efc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 520a5627a806fbbf12f51b5fc605efc4 columnFamilyName cf 2023-07-19 00:11:07,620 INFO [StoreOpener-520a5627a806fbbf12f51b5fc605efc4-1] regionserver.HStore(310): Store=520a5627a806fbbf12f51b5fc605efc4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:07,620 INFO [StoreOpener-6253c3daf7ac4e2e0f6cb3ccecb0c00d-1] regionserver.HStore(310): Store=6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:07,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:07,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:07,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:07,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:07,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 520a5627a806fbbf12f51b5fc605efc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74308070, jitterRate=0.10727652907371521}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:07,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6253c3daf7ac4e2e0f6cb3ccecb0c00d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59566794, jitterRate=-0.11238560080528259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:07,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 520a5627a806fbbf12f51b5fc605efc4: 2023-07-19 00:11:07,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6253c3daf7ac4e2e0f6cb3ccecb0c00d: 2023-07-19 00:11:07,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d., pid=46, masterSystemTime=1689725467612 2023-07-19 00:11:07,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4., pid=45, masterSystemTime=1689725467611 2023-07-19 00:11:07,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,631 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6253c3daf7ac4e2e0f6cb3ccecb0c00d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:07,631 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725467631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725467631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725467631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725467631"}]},"ts":"1689725467631"} 2023-07-19 00:11:07,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:07,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:07,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=520a5627a806fbbf12f51b5fc605efc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:07,632 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725467632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725467632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725467632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725467632"}]},"ts":"1689725467632"} 2023-07-19 00:11:07,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-19 00:11:07,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 6253c3daf7ac4e2e0f6cb3ccecb0c00d, server=jenkins-hbase4.apache.org,39975,1689725421095 in 173 msec 2023-07-19 00:11:07,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-19 00:11:07,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 520a5627a806fbbf12f51b5fc605efc4, server=jenkins-hbase4.apache.org,43375,1689725421035 in 176 msec 2023-07-19 00:11:07,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, ASSIGN in 337 msec 2023-07-19 00:11:07,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 00:11:07,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, ASSIGN in 338 msec 2023-07-19 00:11:07,641 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:07,641 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725467641"}]},"ts":"1689725467641"} 2023-07-19 00:11:07,642 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 00:11:07,645 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:07,646 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 00:11:07,648 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 00:11:07,649 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:07,649 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:07,649 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:07,649 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:07,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:07,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:07,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:07,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:07,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 801 msec 2023-07-19 00:11:07,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:07,961 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 00:11:07,964 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 00:11:07,964 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:07,966 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:07,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725467978 (current time:1689725467978). 2023-07-19 00:11:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x06f979db to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:07,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ee76cb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:07,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:07,988 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:07,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06f979db to 127.0.0.1:57509 2023-07-19 00:11:07,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:07,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x21fa4411 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:07,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c80d654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:07,997 DEBUG [hconnection-0x6907f5d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:07,998 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:08,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21fa4411 to 127.0.0.1:57509 2023-07-19 00:11:08,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:08,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 00:11:08,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:08,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:08,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:08,007 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:08,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:08,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 00:11:08,008 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689726068008 2023-07-19 00:11:08,009 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:08,009 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:08,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:08,011 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:08,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 00:11:08,013 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:08,013 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689726068013 2023-07-19 00:11:08,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,023 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 00:11:08,023 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,025 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 00:11:08,025 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 00:11:08,025 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,025 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,027 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,027 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,027 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,027 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,027 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,027 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,028 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,028 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 00:11:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:08,029 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:08,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,029 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,029 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,031 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:08,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,033 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:08,033 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:08,033 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,033 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:08,033 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:08,039 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,039 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,039 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,039 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,040 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:08,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7806d6b5[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:08,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7806d6b5[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:08,044 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 00:11:08,044 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:08,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:11:08,046 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:08,046 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:08,046 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:08,046 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. started... 2023-07-19 00:11:08,046 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:08,047 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 520a5627a806fbbf12f51b5fc605efc4: 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. started... 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6253c3daf7ac4e2e0f6cb3ccecb0c00d: 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:08,048 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,049 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:08,049 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:08,062 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. completed. 2023-07-19 00:11:08,062 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:08,062 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:08,062 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:08,062 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,062 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. completed. 2023-07-19 00:11:08,062 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:08,062 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:08,062 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:11:08,064 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:08,064 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,064 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,064 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,065 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,065 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:11:08,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 00:11:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:11:08,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 00:11:08,074 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 00:11:08,074 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:08,074 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:08,074 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,074 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:08,075 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,075 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,075 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,075 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,075 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,076 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,075 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,076 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,077 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,077 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,079 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,079 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,080 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,083 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 00:11:08,084 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,084 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,086 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 00:11:08,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,109 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:08,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:08,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:08,111 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:08,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 00:11:08,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,132 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:08,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689725468008Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689725468097 (+89 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689725468097Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689725468097Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689725468100 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689725468107 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689725468131 (+24 ms) 2023-07-19 00:11:08,137 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:08,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 128 msec 2023-07-19 00:11:08,311 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:08,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:08,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:08,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:08,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:08,322 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 00:11:08,322 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:08,322 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:08,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:08,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725468333 (current time:1689725468333). 2023-07-19 00:11:08,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x7cad998a to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:08,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31a98394, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:08,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:08,349 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:08,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cad998a to 127.0.0.1:57509 2023-07-19 00:11:08,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:08,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x19479654 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:08,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9b63d3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:08,357 DEBUG [hconnection-0x74febabe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:08,360 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:08,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19479654 to 127.0.0.1:57509 2023-07-19 00:11:08,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:08,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 00:11:08,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:08,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:08,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:08,368 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:08,369 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689726068369 2023-07-19 00:11:08,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 00:11:08,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:08,371 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:08,371 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:08,372 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:08,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:08,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-19 00:11:08,374 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:08,374 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689726068374 2023-07-19 00:11:08,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 00:11:08,386 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 00:11:08,386 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,388 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 00:11:08,388 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 00:11:08,388 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,388 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,389 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,389 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,389 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,389 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,390 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,390 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,395 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,395 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:08,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 00:11:08,396 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:08,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 00:11:08,397 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:08,397 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:08,397 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:08,399 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:08,397 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:08,401 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,402 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,402 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,402 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,402 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,403 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:08,402 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,403 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,403 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:08,403 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,403 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e54dfac[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:08,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e54dfac[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:08,408 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 00:11:08,408 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,410 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,410 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,410 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,411 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:08,411 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,411 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:08,411 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:08,411 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:08,412 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. started... 2023-07-19 00:11:08,411 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. started... 2023-07-19 00:11:08,412 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6253c3daf7ac4e2e0f6cb3ccecb0c00d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 00:11:08,412 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 520a5627a806fbbf12f51b5fc605efc4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 00:11:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:08,436 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719953da463bc86456cbeb781f7ebf06e92 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719953da463bc86456cbeb781f7ebf06e92 2023-07-19 00:11:08,439 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071906f24e5b6fa24f9db7da7d85d255a323 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071906f24e5b6fa24f9db7da7d85d255a323 2023-07-19 00:11:08,457 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/.tmp/cf/3730c8bc51f34347b9edefe3019e216b 2023-07-19 00:11:08,460 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/.tmp/cf/882586a87b9b400f89e26f713ce9da91 2023-07-19 00:11:08,463 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/.tmp/cf/3730c8bc51f34347b9edefe3019e216b as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf/3730c8bc51f34347b9edefe3019e216b 2023-07-19 00:11:08,465 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/.tmp/cf/882586a87b9b400f89e26f713ce9da91 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf/882586a87b9b400f89e26f713ce9da91 2023-07-19 00:11:08,468 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf/3730c8bc51f34347b9edefe3019e216b, entries=4, sequenceid=6, filesize=5.5 K 2023-07-19 00:11:08,469 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6253c3daf7ac4e2e0f6cb3ccecb0c00d in 57ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:08,469 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 00:11:08,470 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6253c3daf7ac4e2e0f6cb3ccecb0c00d: 2023-07-19 00:11:08,470 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:08,470 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:08,470 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf/3730c8bc51f34347b9edefe3019e216b] hfiles 2023-07-19 00:11:08,470 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf/3730c8bc51f34347b9edefe3019e216b for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:08,471 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf/882586a87b9b400f89e26f713ce9da91, entries=46, sequenceid=6, filesize=12.5 K 2023-07-19 00:11:08,471 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:08,471 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 520a5627a806fbbf12f51b5fc605efc4 in 59ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:08,473 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 520a5627a806fbbf12f51b5fc605efc4: 2023-07-19 00:11:08,473 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:08,473 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:08,473 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf/882586a87b9b400f89e26f713ce9da91] hfiles 2023-07-19 00:11:08,473 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf/882586a87b9b400f89e26f713ce9da91 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:08,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:08,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:08,474 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:08,487 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. completed. 2023-07-19 00:11:08,487 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:11:08,489 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:08,489 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. completed. 2023-07-19 00:11:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,489 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:08,491 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:08,491 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,491 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:08,491 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,493 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,494 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,494 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,494 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:11:08,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 00:11:08,501 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 00:11:08,501 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:08,501 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:08,501 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 00:11:08,501 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:08,504 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,505 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,505 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,506 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,507 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:08,508 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:08,508 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:08,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,515 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:08,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 00:11:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:08,515 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,515 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,515 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,514 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:08,517 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,517 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:08,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 00:11:08,517 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:08,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:08,517 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:08,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:11:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:08,517 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:08,518 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,518 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071906f24e5b6fa24f9db7da7d85d255a323, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719953da463bc86456cbeb781f7ebf06e92] mob files 2023-07-19 00:11:08,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071906f24e5b6fa24f9db7da7d85d255a323 2023-07-19 00:11:08,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719953da463bc86456cbeb781f7ebf06e92 2023-07-19 00:11:08,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 00:11:08,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 00:11:08,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,572 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689725468369Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689725468529 (+160 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689725468530 (+1 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689725468530Writing data manifest for snaptb0-testConsecutiveExports at 1689725468535 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689725468543 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689725468572 (+29 ms) 2023-07-19 00:11:08,575 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:08,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 205 msec 2023-07-19 00:11:08,674 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:08,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:08,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:08,676 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675 2023-07-19 00:11:08,676 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:11:08,699 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:11:08,700 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7074c63, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,700 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 00:11:08,708 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,723 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,795 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-4175212808649350263.jar 2023-07-19 00:11:08,796 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,796 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,797 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,797 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,797 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,798 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:08,798 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:08,798 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:08,799 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:08,799 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:08,800 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:08,800 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:08,800 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:08,801 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:08,801 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:08,801 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:08,802 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:08,802 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:08,803 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:08,803 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:08,803 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:08,803 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:08,804 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:09,666 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:09,669 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 00:11:09,671 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 00:11:11,349 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:11,349 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:11,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:12,120 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:12,159 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:11:16,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:18,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:21,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:22,856 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:22,857 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:22,861 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 00:11:22,861 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:22,861 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:22,862 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:22,864 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:22,864 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:22,864 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@861f440 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:22,864 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:22,864 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:22,865 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:11:22,887 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:11:22,887 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1fc88a68, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:22,887 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 00:11:22,897 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:22,909 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,909 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,909 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,910 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,910 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,910 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,911 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,981 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-1263243614898865228.jar 2023-07-19 00:11:22,982 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,982 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,983 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,983 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,983 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,984 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:22,984 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:22,984 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:22,985 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:22,985 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:22,985 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:22,986 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:22,986 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:22,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:22,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:22,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:22,988 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:22,988 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:22,989 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:22,989 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:22,989 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:22,989 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:22,990 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:23,437 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:23,439 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 00:11:23,441 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 00:11:27,751 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:27,751 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:27,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:28,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:32,748 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:34,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:37,467 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:38,623 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:38,623 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:38,626 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 00:11:38,626 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:38,627 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:38,627 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:38,629 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:38,629 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:38,630 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@861f440 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:38,630 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:38,630 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/local-export-1689725468675/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:38,643 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 00:11:38,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 00:11:38,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 00:11:38,649 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725498649"}]},"ts":"1689725498649"} 2023-07-19 00:11:38,650 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 00:11:38,652 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 00:11:38,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, UNASSIGN}] 2023-07-19 00:11:38,655 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, UNASSIGN 2023-07-19 00:11:38,655 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, UNASSIGN 2023-07-19 00:11:38,656 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6253c3daf7ac4e2e0f6cb3ccecb0c00d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:38,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=520a5627a806fbbf12f51b5fc605efc4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:38,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725498656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725498656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725498656"}]},"ts":"1689725498656"} 2023-07-19 00:11:38,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725498656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725498656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725498656"}]},"ts":"1689725498656"} 2023-07-19 00:11:38,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 520a5627a806fbbf12f51b5fc605efc4, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:38,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 6253c3daf7ac4e2e0f6cb3ccecb0c00d, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:11:38,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 00:11:38,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:38,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 520a5627a806fbbf12f51b5fc605efc4, disabling compactions & flushes 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6253c3daf7ac4e2e0f6cb3ccecb0c00d, disabling compactions & flushes 2023-07-19 00:11:38,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:38,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. after waiting 0 ms 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. after waiting 0 ms 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:38,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:38,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:38,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:38,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:38,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d. 2023-07-19 00:11:38,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4. 2023-07-19 00:11:38,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6253c3daf7ac4e2e0f6cb3ccecb0c00d: 2023-07-19 00:11:38,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 520a5627a806fbbf12f51b5fc605efc4: 2023-07-19 00:11:38,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:38,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6253c3daf7ac4e2e0f6cb3ccecb0c00d, regionState=CLOSED 2023-07-19 00:11:38,840 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725498840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725498840"}]},"ts":"1689725498840"} 2023-07-19 00:11:38,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:38,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=520a5627a806fbbf12f51b5fc605efc4, regionState=CLOSED 2023-07-19 00:11:38,841 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725498841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725498841"}]},"ts":"1689725498841"} 2023-07-19 00:11:38,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 00:11:38,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 6253c3daf7ac4e2e0f6cb3ccecb0c00d, server=jenkins-hbase4.apache.org,39975,1689725421095 in 185 msec 2023-07-19 00:11:38,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 00:11:38,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 520a5627a806fbbf12f51b5fc605efc4, server=jenkins-hbase4.apache.org,43375,1689725421035 in 187 msec 2023-07-19 00:11:38,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6253c3daf7ac4e2e0f6cb3ccecb0c00d, UNASSIGN in 194 msec 2023-07-19 00:11:38,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 00:11:38,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520a5627a806fbbf12f51b5fc605efc4, UNASSIGN in 195 msec 2023-07-19 00:11:38,851 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725498851"}]},"ts":"1689725498851"} 2023-07-19 00:11:38,852 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 00:11:38,853 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 00:11:38,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 210 msec 2023-07-19 00:11:38,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 00:11:38,951 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 00:11:38,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 00:11:38,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:38,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 00:11:38,958 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:38,961 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 00:11:38,965 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:38,965 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:38,965 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,965 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,965 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,965 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:38,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:38,967 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:38,967 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:38,967 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/recovered.edits] 2023-07-19 00:11:38,967 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/recovered.edits] 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,968 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 00:11:38,973 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf/3730c8bc51f34347b9edefe3019e216b to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/cf/3730c8bc51f34347b9edefe3019e216b 2023-07-19 00:11:38,973 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf/882586a87b9b400f89e26f713ce9da91 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/cf/882586a87b9b400f89e26f713ce9da91 2023-07-19 00:11:38,977 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d/recovered.edits/9.seqid 2023-07-19 00:11:38,977 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4/recovered.edits/9.seqid 2023-07-19 00:11:38,977 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/6253c3daf7ac4e2e0f6cb3ccecb0c00d 2023-07-19 00:11:38,977 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testConsecutiveExports/520a5627a806fbbf12f51b5fc605efc4 2023-07-19 00:11:38,978 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 00:11:38,978 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 00:11:38,979 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-19 00:11:38,983 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071906f24e5b6fa24f9db7da7d85d255a323 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071906f24e5b6fa24f9db7da7d85d255a323 2023-07-19 00:11:38,985 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719953da463bc86456cbeb781f7ebf06e92 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719953da463bc86456cbeb781f7ebf06e92 2023-07-19 00:11:38,986 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 00:11:38,988 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:38,991 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 00:11:38,993 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 00:11:38,994 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:38,994 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 00:11:38,994 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725498994"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:38,995 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725498994"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:38,997 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:11:38,997 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6253c3daf7ac4e2e0f6cb3ccecb0c00d, NAME => 'testtb-testConsecutiveExports,,1689725466850.6253c3daf7ac4e2e0f6cb3ccecb0c00d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 520a5627a806fbbf12f51b5fc605efc4, NAME => 'testtb-testConsecutiveExports,1,1689725466850.520a5627a806fbbf12f51b5fc605efc4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:11:38,997 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 00:11:38,997 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725498997"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:38,999 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 00:11:39,001 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:39,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 49 msec 2023-07-19 00:11:39,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 00:11:39,071 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 00:11:39,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 00:11:39,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:39,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 00:11:39,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 00:11:39,114 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 768), OpenFileDescriptor=901 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=511 (was 581), ProcessCount=181 (was 183), AvailableMemoryMB=3086 (was 2544) - AvailableMemoryMB LEAK? - 2023-07-19 00:11:39,114 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-19 00:11:39,135 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=511, ProcessCount=181, AvailableMemoryMB=3085 2023-07-19 00:11:39,135 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-19 00:11:39,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 00:11:39,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,141 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:39,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 00:11:39,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:39,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:39,145 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,145 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,145 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e empty. 2023-07-19 00:11:39,145 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec empty. 2023-07-19 00:11:39,146 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,146 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 00:11:39,161 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:39,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 25f882daa94fe72cb4e2d538cb532e0e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:11:39,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1a0c2ba91ee876bf35efb17eb5d66fec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:11:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 25f882daa94fe72cb4e2d538cb532e0e, disabling compactions & flushes 2023-07-19 00:11:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 1a0c2ba91ee876bf35efb17eb5d66fec, disabling compactions & flushes 2023-07-19 00:11:39,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. after waiting 0 ms 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,193 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. after waiting 0 ms 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 25f882daa94fe72cb4e2d538cb532e0e: 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,193 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,193 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 1a0c2ba91ee876bf35efb17eb5d66fec: 2023-07-19 00:11:39,195 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:39,196 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725499196"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725499196"}]},"ts":"1689725499196"} 2023-07-19 00:11:39,197 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725499196"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725499196"}]},"ts":"1689725499196"} 2023-07-19 00:11:39,202 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:39,203 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:39,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725499203"}]},"ts":"1689725499203"} 2023-07-19 00:11:39,204 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 00:11:39,208 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:39,209 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:39,209 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:39,209 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:39,209 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:39,210 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, ASSIGN}] 2023-07-19 00:11:39,212 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, ASSIGN 2023-07-19 00:11:39,212 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, ASSIGN 2023-07-19 00:11:39,213 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1689725421035; forceNewPlan=false, retain=false 2023-07-19 00:11:39,213 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:11:39,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:39,363 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:39,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=25f882daa94fe72cb4e2d538cb532e0e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1a0c2ba91ee876bf35efb17eb5d66fec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725499366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725499366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725499366"}]},"ts":"1689725499366"} 2023-07-19 00:11:39,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725499366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725499366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725499366"}]},"ts":"1689725499366"} 2023-07-19 00:11:39,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 25f882daa94fe72cb4e2d538cb532e0e, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:39,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 1a0c2ba91ee876bf35efb17eb5d66fec, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:11:39,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:39,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25f882daa94fe72cb4e2d538cb532e0e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:11:39,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. service=AccessControlService 2023-07-19 00:11:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a0c2ba91ee876bf35efb17eb5d66fec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:11:39,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. service=AccessControlService 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:39,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,526 INFO [StoreOpener-25f882daa94fe72cb4e2d538cb532e0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,527 INFO [StoreOpener-1a0c2ba91ee876bf35efb17eb5d66fec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,528 DEBUG [StoreOpener-25f882daa94fe72cb4e2d538cb532e0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf 2023-07-19 00:11:39,528 DEBUG [StoreOpener-1a0c2ba91ee876bf35efb17eb5d66fec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf 2023-07-19 00:11:39,528 DEBUG [StoreOpener-25f882daa94fe72cb4e2d538cb532e0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf 2023-07-19 00:11:39,528 DEBUG [StoreOpener-1a0c2ba91ee876bf35efb17eb5d66fec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf 2023-07-19 00:11:39,530 INFO [StoreOpener-25f882daa94fe72cb4e2d538cb532e0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25f882daa94fe72cb4e2d538cb532e0e columnFamilyName cf 2023-07-19 00:11:39,530 INFO [StoreOpener-1a0c2ba91ee876bf35efb17eb5d66fec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a0c2ba91ee876bf35efb17eb5d66fec columnFamilyName cf 2023-07-19 00:11:39,532 INFO [StoreOpener-25f882daa94fe72cb4e2d538cb532e0e-1] regionserver.HStore(310): Store=25f882daa94fe72cb4e2d538cb532e0e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:39,532 INFO [StoreOpener-1a0c2ba91ee876bf35efb17eb5d66fec-1] regionserver.HStore(310): Store=1a0c2ba91ee876bf35efb17eb5d66fec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:39,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:11:39,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:11:39,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:39,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:39,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a0c2ba91ee876bf35efb17eb5d66fec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67935995, jitterRate=0.012325212359428406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:39,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a0c2ba91ee876bf35efb17eb5d66fec: 2023-07-19 00:11:39,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25f882daa94fe72cb4e2d538cb532e0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67307336, jitterRate=0.002957463264465332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:39,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25f882daa94fe72cb4e2d538cb532e0e: 2023-07-19 00:11:39,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e., pid=60, masterSystemTime=1689725499520 2023-07-19 00:11:39,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec., pid=61, masterSystemTime=1689725499521 2023-07-19 00:11:39,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,544 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=25f882daa94fe72cb4e2d538cb532e0e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,544 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725499544"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725499544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725499544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725499544"}]},"ts":"1689725499544"} 2023-07-19 00:11:39,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,549 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1a0c2ba91ee876bf35efb17eb5d66fec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,549 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725499549"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725499549"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725499549"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725499549"}]},"ts":"1689725499549"} 2023-07-19 00:11:39,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 00:11:39,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 25f882daa94fe72cb4e2d538cb532e0e, server=jenkins-hbase4.apache.org,43375,1689725421035 in 178 msec 2023-07-19 00:11:39,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, ASSIGN in 341 msec 2023-07-19 00:11:39,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 00:11:39,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 1a0c2ba91ee876bf35efb17eb5d66fec, server=jenkins-hbase4.apache.org,39975,1689725421095 in 182 msec 2023-07-19 00:11:39,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-19 00:11:39,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, ASSIGN in 343 msec 2023-07-19 00:11:39,556 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:39,556 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725499556"}]},"ts":"1689725499556"} 2023-07-19 00:11:39,558 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 00:11:39,560 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:39,561 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 00:11:39,563 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 00:11:39,564 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:39,564 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:39,564 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:39,564 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:39,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:39,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:39,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:39,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:39,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 428 msec 2023-07-19 00:11:39,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:39,746 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 00:11:39,749 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,749 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,751 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:39,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725499764 (current time:1689725499764). 2023-07-19 00:11:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x7af54f93 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:39,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63e75a4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:39,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:39,776 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:39,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7af54f93 to 127.0.0.1:57509 2023-07-19 00:11:39,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:39,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x7f13f615 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:39,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f4ab7b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:39,786 DEBUG [hconnection-0x76a68d1a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:39,790 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:39,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f13f615 to 127.0.0.1:57509 2023-07-19 00:11:39,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:39,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 00:11:39,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:39,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:39,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:39,800 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:39,801 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689726099801 2023-07-19 00:11:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:39,801 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,802 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:39,802 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:39,803 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:39,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:39,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-19 00:11:39,805 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:39,806 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689726099806 2023-07-19 00:11:39,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,819 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 00:11:39,819 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,820 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 00:11:39,820 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 00:11:39,820 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,820 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,822 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,822 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,822 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,822 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,823 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,823 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,823 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,823 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:39,824 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:39,825 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,826 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:39,826 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:39,826 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:39,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,827 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:39,827 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:39,827 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,827 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:39,829 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:39,829 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:39,830 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,830 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,831 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46572f9[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:39,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:39,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46572f9[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:39,836 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 00:11:39,836 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,837 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:39,837 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:39,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,837 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:11:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:39,838 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,837 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:39,838 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:39,838 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. started... 2023-07-19 00:11:39,838 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,838 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:39,838 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,838 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25f882daa94fe72cb4e2d538cb532e0e: 2023-07-19 00:11:39,838 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. started... 2023-07-19 00:11:39,839 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1a0c2ba91ee876bf35efb17eb5d66fec: 2023-07-19 00:11:39,839 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,840 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:39,840 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,840 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:39,840 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:39,840 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:39,844 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:39,844 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:39,844 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:39,853 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. completed. 2023-07-19 00:11:39,853 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:11:39,855 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. completed. 2023-07-19 00:11:39,855 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:39,855 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:39,856 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:39,858 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:39,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:11:39,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 00:11:39,865 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 00:11:39,865 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:39,865 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:39,866 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,866 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:39,868 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:39,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:39,869 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:39,869 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,870 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:39,872 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,872 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,873 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,878 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,878 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,877 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:39,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:11:39,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,878 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,880 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:39,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:39,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:39,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 00:11:39,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,902 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:39,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:39,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:39,904 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:39,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 00:11:39,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,959 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:39,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689725499801Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689725499896 (+95 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725499896Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725499896Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725499901 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725499920 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689725499958 (+38 ms) 2023-07-19 00:11:39,962 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:39,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 161 msec 2023-07-19 00:11:40,104 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:40,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:40,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:40,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:40,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:40,116 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,116 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:40,116 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:40,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:40,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725500128 (current time:1689725500128). 2023-07-19 00:11:40,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:40,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x6fc65c46 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:40,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f498592, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:40,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:40,140 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:40,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fc65c46 to 127.0.0.1:57509 2023-07-19 00:11:40,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:40,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x6b43e469 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:40,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36bab12b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:40,148 DEBUG [hconnection-0x56cc77b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:40,149 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:40,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b43e469 to 127.0.0.1:57509 2023-07-19 00:11:40,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:40,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 00:11:40,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:40,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:40,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:40,159 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:40,160 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689726100160 2023-07-19 00:11:40,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:40,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,162 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:40,162 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:40,163 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:40,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:40,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 00:11:40,165 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:40,165 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689726100165 2023-07-19 00:11:40,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,179 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 00:11:40,179 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:40,181 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 00:11:40,181 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 00:11:40,181 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,181 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,182 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,182 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,183 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,183 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,183 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,183 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,184 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,185 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:40,185 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:40,185 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:40,185 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:40,187 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:40,188 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:40,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,188 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:40,188 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:40,188 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:40,188 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:40,189 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:40,189 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:40,189 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:40,189 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:40,189 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,191 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,192 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:40,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28d45089[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:40,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28d45089[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:40,196 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 00:11:40,196 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:40,199 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:11:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:40,199 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:40,199 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,199 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. started... 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:40,199 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:40,199 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:40,200 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. started... 2023-07-19 00:11:40,199 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 25f882daa94fe72cb4e2d538cb532e0e 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 00:11:40,200 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1a0c2ba91ee876bf35efb17eb5d66fec 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 00:11:40,200 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:40,200 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:40,200 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:40,234 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719f73f6bddf1ec4c7aa4df77303cff920f to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719f73f6bddf1ec4c7aa4df77303cff920f 2023-07-19 00:11:40,240 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719669ee68703af4e8c9d7b8b969cbbe8f7 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719669ee68703af4e8c9d7b8b969cbbe8f7 2023-07-19 00:11:40,251 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/.tmp/cf/bd129862669347748805ca42aa240adb 2023-07-19 00:11:40,256 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/.tmp/cf/35ded79bd5d240dbbe0f5c5aac8bebac 2023-07-19 00:11:40,258 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/.tmp/cf/bd129862669347748805ca42aa240adb as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf/bd129862669347748805ca42aa240adb 2023-07-19 00:11:40,262 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:40,263 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:40,271 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf/bd129862669347748805ca42aa240adb, entries=46, sequenceid=6, filesize=13.3 K 2023-07-19 00:11:40,272 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1a0c2ba91ee876bf35efb17eb5d66fec in 72ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:40,272 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 00:11:40,273 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1a0c2ba91ee876bf35efb17eb5d66fec: 2023-07-19 00:11:40,273 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,273 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:40,273 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf/bd129862669347748805ca42aa240adb] hfiles 2023-07-19 00:11:40,273 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf/bd129862669347748805ca42aa240adb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,277 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/.tmp/cf/35ded79bd5d240dbbe0f5c5aac8bebac as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf/35ded79bd5d240dbbe0f5c5aac8bebac 2023-07-19 00:11:40,282 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf/35ded79bd5d240dbbe0f5c5aac8bebac, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 00:11:40,283 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 25f882daa94fe72cb4e2d538cb532e0e in 84ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:40,292 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25f882daa94fe72cb4e2d538cb532e0e: 2023-07-19 00:11:40,292 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,292 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:40,292 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf/35ded79bd5d240dbbe0f5c5aac8bebac] hfiles 2023-07-19 00:11:40,292 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf/35ded79bd5d240dbbe0f5c5aac8bebac for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,322 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. completed. 2023-07-19 00:11:40,322 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:11:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:11:40,324 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:40,324 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,324 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:40,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:11:40,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 00:11:40,464 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:40,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:40,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:40,465 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:11:40,707 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. completed. 2023-07-19 00:11:40,707 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:11:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:11:40,709 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:11:40,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 00:11:40,717 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 00:11:40,717 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:40,717 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:40,717 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,717 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:40,727 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,727 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,727 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,727 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,727 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,728 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,728 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,728 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,729 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,729 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,731 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,731 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,732 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,735 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,736 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:11:40,736 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719f73f6bddf1ec4c7aa4df77303cff920f, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719669ee68703af4e8c9d7b8b969cbbe8f7] mob files 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,739 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719f73f6bddf1ec4c7aa4df77303cff920f 2023-07-19 00:11:40,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719669ee68703af4e8c9d7b8b969cbbe8f7 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,740 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,766 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:40,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:40,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:40,767 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:11:40,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 00:11:40,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,823 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:40,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689725500160Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689725500764 (+604 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689725500764Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689725500764Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689725500769 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689725500779 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689725500823 (+44 ms) 2023-07-19 00:11:40,827 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:40,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 666 msec 2023-07-19 00:11:41,267 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:41,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:41,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:41,299 DEBUG [Listener at jenkins-hbase4.apache.org/43275] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:11:41,305 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:11:41,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 00:11:41,308 DEBUG [Listener at jenkins-hbase4.apache.org/43275] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:11:41,313 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:11:41,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42097] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 00:11:41,314 DEBUG [Listener at jenkins-hbase4.apache.org/43275] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:11:41,316 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:11:41,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 00:11:41,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:11:41,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:41,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:41,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 00:11:41,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:41,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:41,330 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,331 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,331 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 empty. 2023-07-19 00:11:41,331 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 empty. 2023-07-19 00:11:41,331 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,332 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,334 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 00:11:41,355 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:41,359 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 728ef00ab2cdd1ca3b2fd40225986771, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:11:41,359 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1c6a30e762e539886181325acdb950c5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:11:41,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:41,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 728ef00ab2cdd1ca3b2fd40225986771, disabling compactions & flushes 2023-07-19 00:11:41,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. after waiting 0 ms 2023-07-19 00:11:41,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 728ef00ab2cdd1ca3b2fd40225986771: 2023-07-19 00:11:41,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:41,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 1c6a30e762e539886181325acdb950c5, disabling compactions & flushes 2023-07-19 00:11:41,390 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. after waiting 0 ms 2023-07-19 00:11:41,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,390 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 1c6a30e762e539886181325acdb950c5: 2023-07-19 00:11:41,394 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:41,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725501394"}]},"ts":"1689725501394"} 2023-07-19 00:11:41,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725501394"}]},"ts":"1689725501394"} 2023-07-19 00:11:41,397 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:41,398 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:41,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725501398"}]},"ts":"1689725501398"} 2023-07-19 00:11:41,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 00:11:41,402 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:41,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:41,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:41,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:41,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:41,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, ASSIGN}] 2023-07-19 00:11:41,408 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, ASSIGN 2023-07-19 00:11:41,408 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, ASSIGN 2023-07-19 00:11:41,409 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:11:41,409 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1689725421035; forceNewPlan=false, retain=false 2023-07-19 00:11:41,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:41,559 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:41,562 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1c6a30e762e539886181325acdb950c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:41,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=728ef00ab2cdd1ca3b2fd40225986771, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:41,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725501562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725501562"}]},"ts":"1689725501562"} 2023-07-19 00:11:41,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725501562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725501562"}]},"ts":"1689725501562"} 2023-07-19 00:11:41,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 728ef00ab2cdd1ca3b2fd40225986771, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:41,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 1c6a30e762e539886181325acdb950c5, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:11:41,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:41,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c6a30e762e539886181325acdb950c5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 00:11:41,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 728ef00ab2cdd1ca3b2fd40225986771, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 00:11:41,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. service=AccessControlService 2023-07-19 00:11:41,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. service=AccessControlService 2023-07-19 00:11:41,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:41,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,725 INFO [StoreOpener-1c6a30e762e539886181325acdb950c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,725 INFO [StoreOpener-728ef00ab2cdd1ca3b2fd40225986771-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,727 DEBUG [StoreOpener-728ef00ab2cdd1ca3b2fd40225986771-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf 2023-07-19 00:11:41,727 DEBUG [StoreOpener-1c6a30e762e539886181325acdb950c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf 2023-07-19 00:11:41,727 DEBUG [StoreOpener-728ef00ab2cdd1ca3b2fd40225986771-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf 2023-07-19 00:11:41,727 DEBUG [StoreOpener-1c6a30e762e539886181325acdb950c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf 2023-07-19 00:11:41,728 INFO [StoreOpener-1c6a30e762e539886181325acdb950c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6a30e762e539886181325acdb950c5 columnFamilyName cf 2023-07-19 00:11:41,728 INFO [StoreOpener-728ef00ab2cdd1ca3b2fd40225986771-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 728ef00ab2cdd1ca3b2fd40225986771 columnFamilyName cf 2023-07-19 00:11:41,729 INFO [StoreOpener-728ef00ab2cdd1ca3b2fd40225986771-1] regionserver.HStore(310): Store=728ef00ab2cdd1ca3b2fd40225986771/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:41,729 INFO [StoreOpener-1c6a30e762e539886181325acdb950c5-1] regionserver.HStore(310): Store=1c6a30e762e539886181325acdb950c5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:41,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:41,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:41,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 728ef00ab2cdd1ca3b2fd40225986771; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69984745, jitterRate=0.04285396635532379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:41,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 728ef00ab2cdd1ca3b2fd40225986771: 2023-07-19 00:11:41,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c6a30e762e539886181325acdb950c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75297497, jitterRate=0.12202014029026031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:41,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c6a30e762e539886181325acdb950c5: 2023-07-19 00:11:41,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771., pid=69, masterSystemTime=1689725501719 2023-07-19 00:11:41,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5., pid=70, masterSystemTime=1689725501719 2023-07-19 00:11:41,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:41,747 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=728ef00ab2cdd1ca3b2fd40225986771, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:41,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,748 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501747"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725501747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725501747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725501747"}]},"ts":"1689725501747"} 2023-07-19 00:11:41,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:41,748 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1c6a30e762e539886181325acdb950c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:41,748 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725501748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725501748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725501748"}]},"ts":"1689725501748"} 2023-07-19 00:11:41,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 00:11:41,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 728ef00ab2cdd1ca3b2fd40225986771, server=jenkins-hbase4.apache.org,43375,1689725421035 in 184 msec 2023-07-19 00:11:41,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 00:11:41,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 1c6a30e762e539886181325acdb950c5, server=jenkins-hbase4.apache.org,39975,1689725421095 in 183 msec 2023-07-19 00:11:41,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, ASSIGN in 353 msec 2023-07-19 00:11:41,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 00:11:41,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, ASSIGN in 354 msec 2023-07-19 00:11:41,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:41,764 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725501763"}]},"ts":"1689725501763"} 2023-07-19 00:11:41,765 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 00:11:41,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:41,769 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 00:11:41,771 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 00:11:41,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:41,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:41,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:41,773 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:41,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 454 msec 2023-07-19 00:11:41,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:41,929 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 00:11:41,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 728ef00ab2cdd1ca3b2fd40225986771, 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:41,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[728ef00ab2cdd1ca3b2fd40225986771, 1c6a30e762e539886181325acdb950c5], force=true 2023-07-19 00:11:41,965 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[728ef00ab2cdd1ca3b2fd40225986771, 1c6a30e762e539886181325acdb950c5], force=true 2023-07-19 00:11:41,965 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[728ef00ab2cdd1ca3b2fd40225986771, 1c6a30e762e539886181325acdb950c5], force=true 2023-07-19 00:11:41,965 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[728ef00ab2cdd1ca3b2fd40225986771, 1c6a30e762e539886181325acdb950c5], force=true 2023-07-19 00:11:41,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:41,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, UNASSIGN}] 2023-07-19 00:11:41,993 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, UNASSIGN 2023-07-19 00:11:41,993 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, UNASSIGN 2023-07-19 00:11:41,994 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=728ef00ab2cdd1ca3b2fd40225986771, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:41,994 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1c6a30e762e539886181325acdb950c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:41,994 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725501994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725501994"}]},"ts":"1689725501994"} 2023-07-19 00:11:41,994 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725501994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725501994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725501994"}]},"ts":"1689725501994"} 2023-07-19 00:11:41,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 1c6a30e762e539886181325acdb950c5, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:11:41,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 728ef00ab2cdd1ca3b2fd40225986771, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:42,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:42,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:42,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c6a30e762e539886181325acdb950c5, disabling compactions & flushes 2023-07-19 00:11:42,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:42,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:42,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:42,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. after waiting 0 ms 2023-07-19 00:11:42,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:42,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1c6a30e762e539886181325acdb950c5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 00:11:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 728ef00ab2cdd1ca3b2fd40225986771, disabling compactions & flushes 2023-07-19 00:11:42,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:42,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:42,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. after waiting 0 ms 2023-07-19 00:11:42,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:42,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 728ef00ab2cdd1ca3b2fd40225986771 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 00:11:42,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/.tmp/cf/754b7478030f419bab91ecc571633747 2023-07-19 00:11:42,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/.tmp/cf/d470d1d50de144278813509be46b5afb 2023-07-19 00:11:42,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/.tmp/cf/754b7478030f419bab91ecc571633747 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf/754b7478030f419bab91ecc571633747 2023-07-19 00:11:42,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf/754b7478030f419bab91ecc571633747, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 00:11:42,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 728ef00ab2cdd1ca3b2fd40225986771 in 63ms, sequenceid=5, compaction requested=false 2023-07-19 00:11:42,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 00:11:42,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/.tmp/cf/d470d1d50de144278813509be46b5afb as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf/d470d1d50de144278813509be46b5afb 2023-07-19 00:11:42,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf/d470d1d50de144278813509be46b5afb, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 00:11:42,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 00:11:42,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1c6a30e762e539886181325acdb950c5 in 79ms, sequenceid=5, compaction requested=false 2023-07-19 00:11:42,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:42,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771. 2023-07-19 00:11:42,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 728ef00ab2cdd1ca3b2fd40225986771: 2023-07-19 00:11:42,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:11:42,240 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=728ef00ab2cdd1ca3b2fd40225986771, regionState=CLOSED 2023-07-19 00:11:42,240 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725502240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725502240"}]},"ts":"1689725502240"} 2023-07-19 00:11:42,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-19 00:11:42,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 728ef00ab2cdd1ca3b2fd40225986771, server=jenkins-hbase4.apache.org,43375,1689725421035 in 246 msec 2023-07-19 00:11:42,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=728ef00ab2cdd1ca3b2fd40225986771, UNASSIGN in 258 msec 2023-07-19 00:11:42,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 00:11:42,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:42,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5. 2023-07-19 00:11:42,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c6a30e762e539886181325acdb950c5: 2023-07-19 00:11:42,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c6a30e762e539886181325acdb950c5 2023-07-19 00:11:42,260 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1c6a30e762e539886181325acdb950c5, regionState=CLOSED 2023-07-19 00:11:42,260 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725502260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725502260"}]},"ts":"1689725502260"} 2023-07-19 00:11:42,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-19 00:11:42,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 1c6a30e762e539886181325acdb950c5, server=jenkins-hbase4.apache.org,39975,1689725421095 in 271 msec 2023-07-19 00:11:42,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:42,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-19 00:11:42,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1c6a30e762e539886181325acdb950c5, UNASSIGN in 279 msec 2023-07-19 00:11:42,359 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 00:11:42,362 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501319.728ef00ab2cdd1ca3b2fd40225986771.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:42,362 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725501319.1c6a30e762e539886181325acdb950c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:42,362 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:42,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, ASSIGN}] 2023-07-19 00:11:42,434 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, ASSIGN 2023-07-19 00:11:42,435 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43375,1689725421035; forceNewPlan=false, retain=false 2023-07-19 00:11:42,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:42,586 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 00:11:42,588 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=de3cbaf5a99a00cb01afb23a650d7b92, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:42,588 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725502588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725502588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725502588"}]},"ts":"1689725502588"} 2023-07-19 00:11:42,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure de3cbaf5a99a00cb01afb23a650d7b92, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:11:42,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:11:42,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de3cbaf5a99a00cb01afb23a650d7b92, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:11:42,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. service=AccessControlService 2023-07-19 00:11:42,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:42,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:42,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/.regioninfo 2023-07-19 00:11:42,839 INFO [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,842 DEBUG [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf 2023-07-19 00:11:42,842 DEBUG [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf 2023-07-19 00:11:42,843 INFO [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de3cbaf5a99a00cb01afb23a650d7b92 columnFamilyName cf 2023-07-19 00:11:42,895 DEBUG [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] regionserver.HStore(539): loaded hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/754b7478030f419bab91ecc571633747.728ef00ab2cdd1ca3b2fd40225986771->hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf/754b7478030f419bab91ecc571633747-top 2023-07-19 00:11:42,898 DEBUG [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] regionserver.HStore(539): loaded hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/d470d1d50de144278813509be46b5afb.1c6a30e762e539886181325acdb950c5->hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf/d470d1d50de144278813509be46b5afb-top 2023-07-19 00:11:42,899 INFO [StoreOpener-de3cbaf5a99a00cb01afb23a650d7b92-1] regionserver.HStore(310): Store=de3cbaf5a99a00cb01afb23a650d7b92/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:42,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:11:42,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened de3cbaf5a99a00cb01afb23a650d7b92; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65488943, jitterRate=-0.02413870394229889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:42,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for de3cbaf5a99a00cb01afb23a650d7b92: 2023-07-19 00:11:42,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92., pid=77, masterSystemTime=1689725502744 2023-07-19 00:11:42,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.,because compaction is disabled. 2023-07-19 00:11:42,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:11:42,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:11:42,912 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=de3cbaf5a99a00cb01afb23a650d7b92, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:42,913 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725502912"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725502912"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725502912"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725502912"}]},"ts":"1689725502912"} 2023-07-19 00:11:42,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 00:11:42,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure de3cbaf5a99a00cb01afb23a650d7b92, server=jenkins-hbase4.apache.org,43375,1689725421035 in 322 msec 2023-07-19 00:11:42,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 00:11:42,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, ASSIGN in 491 msec 2023-07-19 00:11:42,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[728ef00ab2cdd1ca3b2fd40225986771, 1c6a30e762e539886181325acdb950c5], force=true in 961 msec 2023-07-19 00:11:43,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:43,074 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 00:11:43,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 00:11:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725503075 (current time:1689725503075). 2023-07-19 00:11:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x4f2d1146 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:43,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b314f8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:43,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:43,088 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:43,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f2d1146 to 127.0.0.1:57509 2023-07-19 00:11:43,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:43,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x752e304c to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:43,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52aea88e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:43,121 DEBUG [hconnection-0x3382e847-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:43,125 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:43,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x752e304c to 127.0.0.1:57509 2023-07-19 00:11:43,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:43,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 00:11:43,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:43,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 00:11:43,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 00:11:43,139 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 00:11:43,140 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689726103140 2023-07-19 00:11:43,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 00:11:43,153 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:43,153 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:43,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 00:11:43,156 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 00:11:43,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 19 msec 2023-07-19 00:11:43,162 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 00:11:43,163 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689726103163 2023-07-19 00:11:43,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,217 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 00:11:43,217 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:43,218 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 00:11:43,218 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 00:11:43,219 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,219 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,221 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:43,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:43,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:43,222 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:43,222 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:43,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:43,222 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:43,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:43,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:43,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,223 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,223 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:43,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,224 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 00:11:43,224 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 00:11:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 00:11:43,248 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 00:11:43,248 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 00:11:43,248 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 00:11:43,250 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,251 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,251 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:43,253 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:43,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,255 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 00:11:43,255 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:43,225 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 00:11:43,255 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 00:11:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 00:11:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 00:11:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 00:11:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 00:11:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 00:11:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 00:11:43,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:43,274 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:43,275 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,275 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:43,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 00:11:43,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66a99858[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:43,279 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 00:11:43,279 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 00:11:43,281 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 00:11:43,281 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:11:43,281 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,281 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 00:11:43,281 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 00:11:43,282 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 00:11:43,282 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:11:43,283 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,283 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:43,284 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 00:11:43,284 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:43,284 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 00:11:43,285 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 00:11:43,285 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:43,285 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 00:11:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:43,291 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:43,300 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:11:43,300 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. started... 2023-07-19 00:11:43,305 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de3cbaf5a99a00cb01afb23a650d7b92: 2023-07-19 00:11:43,305 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,305 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:43,305 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/754b7478030f419bab91ecc571633747.728ef00ab2cdd1ca3b2fd40225986771->hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf/754b7478030f419bab91ecc571633747-top, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/d470d1d50de144278813509be46b5afb.1c6a30e762e539886181325acdb950c5->hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf/d470d1d50de144278813509be46b5afb-top] hfiles 2023-07-19 00:11:43,305 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/754b7478030f419bab91ecc571633747.728ef00ab2cdd1ca3b2fd40225986771 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,306 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/d470d1d50de144278813509be46b5afb.1c6a30e762e539886181325acdb950c5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,384 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. completed. 2023-07-19 00:11:43,384 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:11:43,384 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:43,384 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:43,384 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,384 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 00:11:43,384 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:11:43,395 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 00:11:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 00:11:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:11:43,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 00:11:43,406 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 00:11:43,406 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:43,406 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:43,406 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,406 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:43,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:43,409 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:43,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:43,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:43,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:43,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,411 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,412 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:43,413 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,418 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,418 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,419 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,425 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:43,425 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:43,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:43,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:43,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:43,425 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:43,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:43,425 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:43,425 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:43,425 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:43,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:43,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:43,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:43,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:43,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:43,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:43,427 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,427 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:43,426 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,428 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:43,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:43,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,474 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:43,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 00:11:43,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:43,476 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:11:43,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,748 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:43,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 00:11:43,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,773 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689725503140Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725503427 (+287 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725503428 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725503433 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725503554 (+121 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689725503773 (+219 ms) 2023-07-19 00:11:43,787 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:43,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 00:11:43,791 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 00:11:43,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:43,791 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791 2023-07-19 00:11:43,791 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40831, tgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791, rawTgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:11:43,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 639 msec 2023-07-19 00:11:43,849 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:11:43,849 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_713355290_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:43,850 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 00:11:43,918 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:44,065 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,066 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,066 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,068 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,174 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-665862981254211459.jar 2023-07-19 00:11:44,175 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,176 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,176 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,176 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,177 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,177 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:44,179 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:44,179 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:44,179 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:44,182 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:44,182 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:44,182 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:44,183 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:44,183 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:44,184 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:44,184 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:44,184 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:44,185 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:44,185 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:44,185 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:44,559 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:11:46,223 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:46,233 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 00:11:46,236 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 00:11:46,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:46,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:46,747 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:52,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:55,236 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:58,646 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0005_000001 (auth:SIMPLE) 2023-07-19 00:12:00,630 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:12:00,634 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:12:00,644 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,645 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:12:00,645 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:12:00,645 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,646 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 00:12:00,646 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 00:12:00,646 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,647 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 00:12:00,647 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725503791/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 00:12:00,657 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 00:12:00,672 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725520671"}]},"ts":"1689725520671"} 2023-07-19 00:12:00,673 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 00:12:00,675 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 00:12:00,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, UNASSIGN}] 2023-07-19 00:12:00,679 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, UNASSIGN 2023-07-19 00:12:00,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=de3cbaf5a99a00cb01afb23a650d7b92, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:00,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725520680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725520680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725520680"}]},"ts":"1689725520680"} 2023-07-19 00:12:00,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure de3cbaf5a99a00cb01afb23a650d7b92, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:12:00,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 00:12:00,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:12:00,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing de3cbaf5a99a00cb01afb23a650d7b92, disabling compactions & flushes 2023-07-19 00:12:00,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:12:00,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:12:00,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. after waiting 0 ms 2023-07-19 00:12:00,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:12:00,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 00:12:00,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:00,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92. 2023-07-19 00:12:00,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for de3cbaf5a99a00cb01afb23a650d7b92: 2023-07-19 00:12:00,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:12:00,854 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=de3cbaf5a99a00cb01afb23a650d7b92, regionState=CLOSED 2023-07-19 00:12:00,854 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725520854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725520854"}]},"ts":"1689725520854"} 2023-07-19 00:12:00,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 00:12:00,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure de3cbaf5a99a00cb01afb23a650d7b92, server=jenkins-hbase4.apache.org,43375,1689725421035 in 174 msec 2023-07-19 00:12:00,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 00:12:00,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=de3cbaf5a99a00cb01afb23a650d7b92, UNASSIGN in 182 msec 2023-07-19 00:12:00,861 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725520861"}]},"ts":"1689725520861"} 2023-07-19 00:12:00,866 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 00:12:00,868 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 00:12:00,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 212 msec 2023-07-19 00:12:00,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 00:12:00,974 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 00:12:00,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,979 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,980 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,981 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,986 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 2023-07-19 00:12:00,987 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:12:00,987 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:12:00,987 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,987 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,987 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,987 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:12:00,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:12:00,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:12:00,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:12:00,989 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/recovered.edits] 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:00,989 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:00,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:00,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 00:12:00,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:00,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:00,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:00,991 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/recovered.edits] 2023-07-19 00:12:00,991 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/recovered.edits] 2023-07-19 00:12:00,996 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf/d470d1d50de144278813509be46b5afb to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/cf/d470d1d50de144278813509be46b5afb 2023-07-19 00:12:00,998 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/754b7478030f419bab91ecc571633747.728ef00ab2cdd1ca3b2fd40225986771 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/754b7478030f419bab91ecc571633747.728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:12:00,998 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf/754b7478030f419bab91ecc571633747 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/cf/754b7478030f419bab91ecc571633747 2023-07-19 00:12:01,002 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/d470d1d50de144278813509be46b5afb.1c6a30e762e539886181325acdb950c5 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/cf/d470d1d50de144278813509be46b5afb.1c6a30e762e539886181325acdb950c5 2023-07-19 00:12:01,005 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/recovered.edits/8.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5/recovered.edits/8.seqid 2023-07-19 00:12:01,006 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1c6a30e762e539886181325acdb950c5 2023-07-19 00:12:01,007 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/recovered.edits/8.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771/recovered.edits/8.seqid 2023-07-19 00:12:01,007 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/728ef00ab2cdd1ca3b2fd40225986771 2023-07-19 00:12:01,018 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/recovered.edits/12.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92/recovered.edits/12.seqid 2023-07-19 00:12:01,022 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/de3cbaf5a99a00cb01afb23a650d7b92 2023-07-19 00:12:01,022 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 00:12:01,025 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:01,028 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 00:12:01,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 00:12:01,047 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:01,047 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 00:12:01,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725521047"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:01,049 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 00:12:01,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => de3cbaf5a99a00cb01afb23a650d7b92, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725501320.de3cbaf5a99a00cb01afb23a650d7b92.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 00:12:01,050 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 00:12:01,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725521050"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:01,053 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 00:12:01,057 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:01,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 82 msec 2023-07-19 00:12:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 00:12:01,092 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 00:12:01,093 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 00:12:01,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725521100"}]},"ts":"1689725521100"} 2023-07-19 00:12:01,102 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 00:12:01,104 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 00:12:01,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, UNASSIGN}] 2023-07-19 00:12:01,106 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, UNASSIGN 2023-07-19 00:12:01,108 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, UNASSIGN 2023-07-19 00:12:01,109 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1a0c2ba91ee876bf35efb17eb5d66fec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:01,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725521109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725521109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725521109"}]},"ts":"1689725521109"} 2023-07-19 00:12:01,109 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=25f882daa94fe72cb4e2d538cb532e0e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:01,110 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725521109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725521109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725521109"}]},"ts":"1689725521109"} 2023-07-19 00:12:01,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 25f882daa94fe72cb4e2d538cb532e0e, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:12:01,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 1a0c2ba91ee876bf35efb17eb5d66fec, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:12:01,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 00:12:01,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:12:01,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25f882daa94fe72cb4e2d538cb532e0e, disabling compactions & flushes 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a0c2ba91ee876bf35efb17eb5d66fec, disabling compactions & flushes 2023-07-19 00:12:01,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:12:01,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. after waiting 0 ms 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. after waiting 0 ms 2023-07-19 00:12:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:12:01,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:01,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:01,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:01,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:01,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e. 2023-07-19 00:12:01,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec. 2023-07-19 00:12:01,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25f882daa94fe72cb4e2d538cb532e0e: 2023-07-19 00:12:01,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a0c2ba91ee876bf35efb17eb5d66fec: 2023-07-19 00:12:01,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:12:01,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1a0c2ba91ee876bf35efb17eb5d66fec, regionState=CLOSED 2023-07-19 00:12:01,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:12:01,285 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725521284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725521284"}]},"ts":"1689725521284"} 2023-07-19 00:12:01,285 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=25f882daa94fe72cb4e2d538cb532e0e, regionState=CLOSED 2023-07-19 00:12:01,286 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725521285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725521285"}]},"ts":"1689725521285"} 2023-07-19 00:12:01,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 00:12:01,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 00:12:01,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 1a0c2ba91ee876bf35efb17eb5d66fec, server=jenkins-hbase4.apache.org,39975,1689725421095 in 175 msec 2023-07-19 00:12:01,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 25f882daa94fe72cb4e2d538cb532e0e, server=jenkins-hbase4.apache.org,43375,1689725421035 in 176 msec 2023-07-19 00:12:01,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1a0c2ba91ee876bf35efb17eb5d66fec, UNASSIGN in 187 msec 2023-07-19 00:12:01,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-19 00:12:01,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=25f882daa94fe72cb4e2d538cb532e0e, UNASSIGN in 187 msec 2023-07-19 00:12:01,294 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725521294"}]},"ts":"1689725521294"} 2023-07-19 00:12:01,296 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 00:12:01,299 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 00:12:01,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 205 msec 2023-07-19 00:12:01,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 00:12:01,401 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 00:12:01,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,407 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,410 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,413 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,413 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,413 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 00:12:01,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 00:12:01,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 00:12:01,416 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:12:01,416 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:12:01,418 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 00:12:01,422 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,422 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,423 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,423 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:01,422 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:01,422 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,423 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:01,423 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:01,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 00:12:01,425 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/recovered.edits] 2023-07-19 00:12:01,426 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/recovered.edits] 2023-07-19 00:12:01,440 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf/bd129862669347748805ca42aa240adb to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/cf/bd129862669347748805ca42aa240adb 2023-07-19 00:12:01,440 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf/35ded79bd5d240dbbe0f5c5aac8bebac to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/cf/35ded79bd5d240dbbe0f5c5aac8bebac 2023-07-19 00:12:01,446 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec/recovered.edits/9.seqid 2023-07-19 00:12:01,446 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e/recovered.edits/9.seqid 2023-07-19 00:12:01,447 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1a0c2ba91ee876bf35efb17eb5d66fec 2023-07-19 00:12:01,447 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/25f882daa94fe72cb4e2d538cb532e0e 2023-07-19 00:12:01,447 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 00:12:01,447 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 00:12:01,449 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-19 00:12:01,462 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719f73f6bddf1ec4c7aa4df77303cff920f to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719f73f6bddf1ec4c7aa4df77303cff920f 2023-07-19 00:12:01,464 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719669ee68703af4e8c9d7b8b969cbbe8f7 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719669ee68703af4e8c9d7b8b969cbbe8f7 2023-07-19 00:12:01,464 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 00:12:01,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,471 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 00:12:01,482 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 00:12:01,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 00:12:01,484 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725521484"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:01,484 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725521484"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:01,487 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:12:01,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 25f882daa94fe72cb4e2d538cb532e0e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689725499137.25f882daa94fe72cb4e2d538cb532e0e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1a0c2ba91ee876bf35efb17eb5d66fec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725499137.1a0c2ba91ee876bf35efb17eb5d66fec.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:12:01,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 00:12:01,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725521487"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:01,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 00:12:01,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 88 msec 2023-07-19 00:12:01,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 00:12:01,526 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 00:12:01,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 00:12:01,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 00:12:01,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:12:01,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 00:12:01,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:12:01,578 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 749) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4339 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:55396 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:45949 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:52036 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:41380 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2127797268_1 at /127.0.0.1:37080 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 901), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=488 (was 511), ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2125 (was 3085) 2023-07-19 00:12:01,578 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-19 00:12:01,602 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=488, ProcessCount=184, AvailableMemoryMB=2122 2023-07-19 00:12:01,603 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-19 00:12:01,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 00:12:01,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:01,608 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:12:01,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 00:12:01,609 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:12:01,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:12:01,612 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:01,612 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:01,613 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c empty. 2023-07-19 00:12:01,613 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a empty. 2023-07-19 00:12:01,613 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:01,613 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:01,613 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 00:12:01,641 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 00:12:01,647 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 28371e5fa7ca41d7059b161f26eaec2a, NAME => 'testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:12:01,648 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 185187c6c1cbdfeebb303d8f8ec2cf2c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:12:01,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:01,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 28371e5fa7ca41d7059b161f26eaec2a, disabling compactions & flushes 2023-07-19 00:12:01,692 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:01,692 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:01,692 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. after waiting 0 ms 2023-07-19 00:12:01,692 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:01,692 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:01,692 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 28371e5fa7ca41d7059b161f26eaec2a: 2023-07-19 00:12:01,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:12:01,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:12:02,090 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:02,090 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 185187c6c1cbdfeebb303d8f8ec2cf2c, disabling compactions & flushes 2023-07-19 00:12:02,090 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,090 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,090 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. after waiting 0 ms 2023-07-19 00:12:02,090 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,090 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,090 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 185187c6c1cbdfeebb303d8f8ec2cf2c: 2023-07-19 00:12:02,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:12:02,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725522095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725522095"}]},"ts":"1689725522095"} 2023-07-19 00:12:02,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725522095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725522095"}]},"ts":"1689725522095"} 2023-07-19 00:12:02,097 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:12:02,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:12:02,098 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725522098"}]},"ts":"1689725522098"} 2023-07-19 00:12:02,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 00:12:02,104 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:12:02,106 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:12:02,106 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:12:02,106 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:12:02,106 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:12:02,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, ASSIGN}] 2023-07-19 00:12:02,109 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, ASSIGN 2023-07-19 00:12:02,110 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, ASSIGN 2023-07-19 00:12:02,115 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:12:02,115 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1689725421035; forceNewPlan=false, retain=false 2023-07-19 00:12:02,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:12:02,266 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:12:02,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=28371e5fa7ca41d7059b161f26eaec2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:02,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=185187c6c1cbdfeebb303d8f8ec2cf2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:02,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725522269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725522269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725522269"}]},"ts":"1689725522269"} 2023-07-19 00:12:02,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725522269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725522269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725522269"}]},"ts":"1689725522269"} 2023-07-19 00:12:02,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 28371e5fa7ca41d7059b161f26eaec2a, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:12:02,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 185187c6c1cbdfeebb303d8f8ec2cf2c, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:12:02,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:02,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28371e5fa7ca41d7059b161f26eaec2a, NAME => 'testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:12:02,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. service=AccessControlService 2023-07-19 00:12:02,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:12:02,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:02,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 185187c6c1cbdfeebb303d8f8ec2cf2c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:12:02,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. service=AccessControlService 2023-07-19 00:12:02,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:12:02,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:02,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,447 INFO [StoreOpener-28371e5fa7ca41d7059b161f26eaec2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,449 INFO [StoreOpener-185187c6c1cbdfeebb303d8f8ec2cf2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,450 DEBUG [StoreOpener-28371e5fa7ca41d7059b161f26eaec2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf 2023-07-19 00:12:02,450 DEBUG [StoreOpener-28371e5fa7ca41d7059b161f26eaec2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf 2023-07-19 00:12:02,450 INFO [StoreOpener-28371e5fa7ca41d7059b161f26eaec2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28371e5fa7ca41d7059b161f26eaec2a columnFamilyName cf 2023-07-19 00:12:02,451 DEBUG [StoreOpener-185187c6c1cbdfeebb303d8f8ec2cf2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf 2023-07-19 00:12:02,451 DEBUG [StoreOpener-185187c6c1cbdfeebb303d8f8ec2cf2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf 2023-07-19 00:12:02,452 INFO [StoreOpener-185187c6c1cbdfeebb303d8f8ec2cf2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 185187c6c1cbdfeebb303d8f8ec2cf2c columnFamilyName cf 2023-07-19 00:12:02,452 INFO [StoreOpener-28371e5fa7ca41d7059b161f26eaec2a-1] regionserver.HStore(310): Store=28371e5fa7ca41d7059b161f26eaec2a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:12:02,453 INFO [StoreOpener-185187c6c1cbdfeebb303d8f8ec2cf2c-1] regionserver.HStore(310): Store=185187c6c1cbdfeebb303d8f8ec2cf2c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:12:02,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:02,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:02,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:12:02,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:12:02,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28371e5fa7ca41d7059b161f26eaec2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61519568, jitterRate=-0.08328700065612793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:12:02,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28371e5fa7ca41d7059b161f26eaec2a: 2023-07-19 00:12:02,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 185187c6c1cbdfeebb303d8f8ec2cf2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63963723, jitterRate=-0.04686625301837921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:12:02,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 185187c6c1cbdfeebb303d8f8ec2cf2c: 2023-07-19 00:12:02,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c., pid=94, masterSystemTime=1689725522427 2023-07-19 00:12:02,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a., pid=93, masterSystemTime=1689725522426 2023-07-19 00:12:02,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:02,485 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=185187c6c1cbdfeebb303d8f8ec2cf2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:02,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:02,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:02,485 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725522485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725522485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725522485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725522485"}]},"ts":"1689725522485"} 2023-07-19 00:12:02,486 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=28371e5fa7ca41d7059b161f26eaec2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:02,486 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725522486"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725522486"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725522486"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725522486"}]},"ts":"1689725522486"} 2023-07-19 00:12:02,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 00:12:02,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 00:12:02,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 185187c6c1cbdfeebb303d8f8ec2cf2c, server=jenkins-hbase4.apache.org,39975,1689725421095 in 213 msec 2023-07-19 00:12:02,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 28371e5fa7ca41d7059b161f26eaec2a, server=jenkins-hbase4.apache.org,43375,1689725421035 in 215 msec 2023-07-19 00:12:02,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, ASSIGN in 385 msec 2023-07-19 00:12:02,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 00:12:02,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, ASSIGN in 385 msec 2023-07-19 00:12:02,495 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:12:02,495 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725522495"}]},"ts":"1689725522495"} 2023-07-19 00:12:02,497 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 00:12:02,499 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:12:02,499 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 00:12:02,501 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:12:02,503 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:02,503 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:02,503 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:02,503 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:02,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:02,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:02,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:02,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:02,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 901 msec 2023-07-19 00:12:02,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:12:02,716 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 00:12:02,720 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:02,721 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:02,723 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:02,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:12:02,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725522761 (current time:1689725522761). 2023-07-19 00:12:02,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:12:02,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x2df79f47 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:02,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1db99b24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:02,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:02,803 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:02,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2df79f47 to 127.0.0.1:57509 2023-07-19 00:12:02,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:02,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x3a6e496c to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:02,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf2e4c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:02,855 DEBUG [hconnection-0x7ac32a20-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:02,857 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:02,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a6e496c to 127.0.0.1:57509 2023-07-19 00:12:02,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:02,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:12:02,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:12:02,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:12:02,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:12:02,875 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:12:02,877 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726122877 2023-07-19 00:12:02,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:12:02,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:02,882 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:12:02,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-19 00:12:02,887 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:12:02,887 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:12:02,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:12:02,894 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:12:02,895 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726122895 2023-07-19 00:12:02,987 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:02,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:02,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:02,989 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:12:03,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,036 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 00:12:03,036 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:03,036 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 00:12:03,036 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:12:03,037 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,037 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,047 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:03,047 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:03,047 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,047 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:03,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:03,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:03,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:03,048 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,048 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,049 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,049 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:12:03,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 00:12:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 00:12:03,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:12:03,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:12:03,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 00:12:03,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:12:03,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,059 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:12:03,059 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:03,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,064 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:12:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:12:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:12:03,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:12:03,071 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:12:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:12:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:12:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:12:03,072 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:12:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:12:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:03,079 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:03,082 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:03,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:12:03,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ee8929e[Count = 1] remaining members to acquire global barrier 2023-07-19 00:12:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:03,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:12:03,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ee8929e[Count = 0] remaining members to acquire global barrier 2023-07-19 00:12:03,108 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:12:03,108 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:12:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:12:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:12:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:12:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:12:03,110 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,111 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,111 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:12:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:12:03,114 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:03,114 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:12:03,118 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:03,118 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:03,132 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:03,132 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. started... 2023-07-19 00:12:03,134 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:03,135 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:03,136 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 185187c6c1cbdfeebb303d8f8ec2cf2c: 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. started... 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 28371e5fa7ca41d7059b161f26eaec2a: 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:03,137 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:12:03,191 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:03,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:03,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:03,194 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:12:03,219 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. completed. 2023-07-19 00:12:03,219 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:03,219 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:03,219 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:03,219 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:12:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:12:03,233 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:12:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:12:03,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:12:03,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:12:03,257 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. completed. 2023-07-19 00:12:03,257 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:03,258 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:03,258 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:03,258 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,258 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:12:03,258 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:12:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:12:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:12:03,262 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:03,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:03,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:03,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:03,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:12:03,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:12:03,271 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 00:12:03,271 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:12:03,271 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:12:03,271 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,271 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:12:03,273 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,273 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:03,273 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:03,273 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:03,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:03,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:03,275 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:03,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,275 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,276 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:03,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,279 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:03,279 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,279 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:03,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:03,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:03,285 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,285 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,285 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:03,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:03,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:03,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:03,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:03,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:03,285 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:03,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:12:03,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:03,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 00:12:03,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,494 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:03,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:03,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:03,495 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:12:03,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 00:12:03,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,560 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:03,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689725522878Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689725523357 (+479 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689725523357Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689725523357Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689725523386 (+29 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689725523412 (+26 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689725523559 (+147 ms) 2023-07-19 00:12:03,565 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:12:03,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 684 msec 2023-07-19 00:12:03,996 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:03,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:03,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:12:04,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:12:04,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:12:04,029 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:04,030 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:04,030 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:04,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:12:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725524043 (current time:1689725524043). 2023-07-19 00:12:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:12:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x37a56234 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:04,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54d4dcca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:04,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:04,067 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37a56234 to 127.0.0.1:57509 2023-07-19 00:12:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:04,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x74b894d4 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:04,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6810fcb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:04,107 DEBUG [hconnection-0x1a505ff1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:04,111 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:04,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74b894d4 to 127.0.0.1:57509 2023-07-19 00:12:04,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:04,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:12:04,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:12:04,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:12:04,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:12:04,129 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:12:04,129 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726124129 2023-07-19 00:12:04,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:12:04,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:04,132 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:12:04,132 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:12:04,136 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:12:04,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:12:04,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-19 00:12:04,139 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:12:04,142 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726124142 2023-07-19 00:12:04,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,194 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 00:12:04,194 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:04,196 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 00:12:04,196 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:12:04,227 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,227 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,229 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:04,229 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:04,229 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:04,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:04,229 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:04,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:04,230 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,230 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,230 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,230 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:12:04,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:12:04,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:12:04,231 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:12:04,232 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:04,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:04,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:04,233 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:12:04,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,235 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:12:04,235 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,237 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:12:04,237 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:12:04,242 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:04,242 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:12:04,237 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:12:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:12:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:12:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:12:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:12:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:12:04,249 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,249 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,250 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,250 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:04,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:12:04,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21b5db00[Count = 1] remaining members to acquire global barrier 2023-07-19 00:12:04,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:04,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21b5db00[Count = 0] remaining members to acquire global barrier 2023-07-19 00:12:04,258 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:12:04,258 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:12:04,264 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,263 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,264 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:12:04,264 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:12:04,264 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:12:04,264 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,264 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:12:04,264 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:12:04,266 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:12:04,266 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:04,266 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:12:04,270 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:04,276 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:04,274 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:04,276 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:04,276 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:04,276 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. started... 2023-07-19 00:12:04,276 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:04,277 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. started... 2023-07-19 00:12:04,277 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 185187c6c1cbdfeebb303d8f8ec2cf2c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 00:12:04,277 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 28371e5fa7ca41d7059b161f26eaec2a 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 00:12:04,335 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719698fdd53fe914d2ca5c51fb5aceea14c to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719698fdd53fe914d2ca5c51fb5aceea14c 2023-07-19 00:12:04,365 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719c80ac880459a403ba5b997b0845d3129 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719c80ac880459a403ba5b997b0845d3129 2023-07-19 00:12:04,383 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/.tmp/cf/077a076e0dec4fb680a5bfbe0350bcf3 2023-07-19 00:12:04,390 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/.tmp/cf/077a076e0dec4fb680a5bfbe0350bcf3 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf/077a076e0dec4fb680a5bfbe0350bcf3 2023-07-19 00:12:04,395 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf/077a076e0dec4fb680a5bfbe0350bcf3, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 00:12:04,396 INFO [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 28371e5fa7ca41d7059b161f26eaec2a in 119ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:04,396 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 00:12:04,397 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 28371e5fa7ca41d7059b161f26eaec2a: 2023-07-19 00:12:04,397 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,412 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:04,413 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf/077a076e0dec4fb680a5bfbe0350bcf3] hfiles 2023-07-19 00:12:04,413 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf/077a076e0dec4fb680a5bfbe0350bcf3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,433 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/.tmp/cf/339d51371d074160b1c880ee5aff4e21 2023-07-19 00:12:04,433 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:04,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:04,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:04,438 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:12:04,453 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/.tmp/cf/339d51371d074160b1c880ee5aff4e21 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf/339d51371d074160b1c880ee5aff4e21 2023-07-19 00:12:04,460 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf/339d51371d074160b1c880ee5aff4e21, entries=47, sequenceid=6, filesize=13.1 K 2023-07-19 00:12:04,461 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 185187c6c1cbdfeebb303d8f8ec2cf2c in 184ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:04,464 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 185187c6c1cbdfeebb303d8f8ec2cf2c: 2023-07-19 00:12:04,464 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,464 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:04,464 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf/339d51371d074160b1c880ee5aff4e21] hfiles 2023-07-19 00:12:04,464 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf/339d51371d074160b1c880ee5aff4e21 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,495 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. completed. 2023-07-19 00:12:04,495 DEBUG [rs(jenkins-hbase4.apache.org,43375,1689725421035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:04,495 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:04,495 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:04,495 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,495 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:12:04,495 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:12:04,497 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,497 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:12:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:04,497 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:04,497 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:12:04,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:04,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:04,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43375,1689725421035': 2023-07-19 00:12:04,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:12:04,525 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. completed. 2023-07-19 00:12:04,526 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:04,526 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:04,526 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:04,526 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,526 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:12:04,526 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:12:04,528 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:12:04,528 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,528 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:04,528 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:12:04,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:12:04,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:12:04,536 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 00:12:04,536 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:12:04,536 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:12:04,536 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,536 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:12:04,539 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,539 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:04,539 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,540 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:04,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,539 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,540 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:04,539 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:04,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:04,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:04,541 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:04,547 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,548 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,554 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,554 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,555 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,558 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:04,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:04,558 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:04,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:04,558 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:04,558 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:04,558 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:04,558 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:04,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:04,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:04,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:04,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,559 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:04,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:04,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:04,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:04,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:04,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:12:04,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:04,563 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,563 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719c80ac880459a403ba5b997b0845d3129, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719698fdd53fe914d2ca5c51fb5aceea14c] mob files 2023-07-19 00:12:04,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719c80ac880459a403ba5b997b0845d3129 2023-07-19 00:12:04,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719698fdd53fe914d2ca5c51fb5aceea14c 2023-07-19 00:12:04,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,739 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:04,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:04,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:04,740 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:12:04,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0005_000001 (auth:SIMPLE) 2023-07-19 00:12:04,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 00:12:04,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,944 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689725524130Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689725524660 (+530 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689725524660Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689725524660Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689725524700 (+40 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689725524804 (+104 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689725524943 (+139 ms) 2023-07-19 00:12:04,951 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:12:04,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 820 msec 2023-07-19 00:12:05,240 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:12:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:12:05,242 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242 2023-07-19 00:12:05,242 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40831, tgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242, rawTgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:12:05,276 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:12:05,277 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-386680741_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:05,277 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 00:12:05,301 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:05,426 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,426 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,427 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,427 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,428 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,428 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,428 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,518 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-5950841300034240497.jar 2023-07-19 00:12:05,519 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,520 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,520 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,521 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,521 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,522 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:05,522 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:12:05,523 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:12:05,524 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:12:05,524 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:12:05,525 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:12:05,525 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:12:05,526 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:12:05,526 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:12:05,527 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:12:05,527 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:12:05,528 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:05,529 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:05,529 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:05,530 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:05,530 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:05,531 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:05,531 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:06,533 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:12:07,104 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:12:07,106 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 00:12:07,193 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:07,193 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:07,785 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0006_000001 (auth:SIMPLE) 2023-07-19 00:12:12,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0006_000001 (auth:SIMPLE) 2023-07-19 00:12:15,341 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:12:15,342 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:12:15,357 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:15,357 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:12:15,358 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:12:15,358 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:15,358 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 00:12:15,359 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 00:12:15,359 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:15,359 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 00:12:15,359 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725525242/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 00:12:15,366 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 00:12:15,371 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725535371"}]},"ts":"1689725535371"} 2023-07-19 00:12:15,373 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 00:12:15,375 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 00:12:15,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, UNASSIGN}] 2023-07-19 00:12:15,378 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, UNASSIGN 2023-07-19 00:12:15,378 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, UNASSIGN 2023-07-19 00:12:15,379 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=28371e5fa7ca41d7059b161f26eaec2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:15,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=185187c6c1cbdfeebb303d8f8ec2cf2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:15,379 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725535379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725535379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725535379"}]},"ts":"1689725535379"} 2023-07-19 00:12:15,379 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725535379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725535379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725535379"}]},"ts":"1689725535379"} 2023-07-19 00:12:15,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 28371e5fa7ca41d7059b161f26eaec2a, server=jenkins-hbase4.apache.org,43375,1689725421035}] 2023-07-19 00:12:15,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 185187c6c1cbdfeebb303d8f8ec2cf2c, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:12:15,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 00:12:15,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 185187c6c1cbdfeebb303d8f8ec2cf2c, disabling compactions & flushes 2023-07-19 00:12:15,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. after waiting 0 ms 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:15,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28371e5fa7ca41d7059b161f26eaec2a, disabling compactions & flushes 2023-07-19 00:12:15,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. after waiting 0 ms 2023-07-19 00:12:15,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:15,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:15,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:15,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:15,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c. 2023-07-19 00:12:15,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 185187c6c1cbdfeebb303d8f8ec2cf2c: 2023-07-19 00:12:15,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:15,594 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=185187c6c1cbdfeebb303d8f8ec2cf2c, regionState=CLOSED 2023-07-19 00:12:15,594 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725535594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725535594"}]},"ts":"1689725535594"} 2023-07-19 00:12:15,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:15,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a. 2023-07-19 00:12:15,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28371e5fa7ca41d7059b161f26eaec2a: 2023-07-19 00:12:15,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:15,599 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=28371e5fa7ca41d7059b161f26eaec2a, regionState=CLOSED 2023-07-19 00:12:15,600 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725535599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725535599"}]},"ts":"1689725535599"} 2023-07-19 00:12:15,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 00:12:15,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 185187c6c1cbdfeebb303d8f8ec2cf2c, server=jenkins-hbase4.apache.org,39975,1689725421095 in 218 msec 2023-07-19 00:12:15,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 00:12:15,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=185187c6c1cbdfeebb303d8f8ec2cf2c, UNASSIGN in 227 msec 2023-07-19 00:12:15,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 28371e5fa7ca41d7059b161f26eaec2a, server=jenkins-hbase4.apache.org,43375,1689725421035 in 220 msec 2023-07-19 00:12:15,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 00:12:15,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=28371e5fa7ca41d7059b161f26eaec2a, UNASSIGN in 229 msec 2023-07-19 00:12:15,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725535608"}]},"ts":"1689725535608"} 2023-07-19 00:12:15,610 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 00:12:15,611 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 00:12:15,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 246 msec 2023-07-19 00:12:15,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 00:12:15,674 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 00:12:15,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,678 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,679 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,681 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,684 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,684 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,684 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,684 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 00:12:15,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 00:12:15,686 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:15,687 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:15,689 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/recovered.edits] 2023-07-19 00:12:15,690 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/recovered.edits] 2023-07-19 00:12:15,694 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf/339d51371d074160b1c880ee5aff4e21 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/cf/339d51371d074160b1c880ee5aff4e21 2023-07-19 00:12:15,695 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,695 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:15,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-19 00:12:15,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-19 00:12:15,695 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:12:15,695 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:15,695 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,695 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:15,695 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:15,695 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:12:15,696 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf/077a076e0dec4fb680a5bfbe0350bcf3 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/cf/077a076e0dec4fb680a5bfbe0350bcf3 2023-07-19 00:12:15,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 00:12:15,700 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c/recovered.edits/9.seqid 2023-07-19 00:12:15,701 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/185187c6c1cbdfeebb303d8f8ec2cf2c 2023-07-19 00:12:15,703 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a/recovered.edits/9.seqid 2023-07-19 00:12:15,704 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testEmptyExportFileSystemState/28371e5fa7ca41d7059b161f26eaec2a 2023-07-19 00:12:15,704 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 00:12:15,705 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 00:12:15,705 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-19 00:12:15,716 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719c80ac880459a403ba5b997b0845d3129 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719c80ac880459a403ba5b997b0845d3129 2023-07-19 00:12:15,718 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719698fdd53fe914d2ca5c51fb5aceea14c to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719698fdd53fe914d2ca5c51fb5aceea14c 2023-07-19 00:12:15,718 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 00:12:15,722 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,726 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 00:12:15,729 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 00:12:15,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 00:12:15,731 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725535731"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:15,731 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725535731"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:15,733 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:12:15,733 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 28371e5fa7ca41d7059b161f26eaec2a, NAME => 'testtb-testEmptyExportFileSystemState,,1689725521604.28371e5fa7ca41d7059b161f26eaec2a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 185187c6c1cbdfeebb303d8f8ec2cf2c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689725521604.185187c6c1cbdfeebb303d8f8ec2cf2c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:12:15,734 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 00:12:15,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725535734"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:15,739 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 00:12:15,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:15,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 66 msec 2023-07-19 00:12:15,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 00:12:15,799 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 00:12:15,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 00:12:15,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:15,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 00:12:15,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:15,855 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1262310882_17 at /127.0.0.1:57954 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1197175690_1 at /127.0.0.1:50778 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:50824 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1197175690_1 at /127.0.0.1:59226 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:59234 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:40527 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:38883 from appattempt_1689725428933_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-5023 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=920 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=498 (was 488) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 184), AvailableMemoryMB=1453 (was 2122) 2023-07-19 00:12:15,856 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 00:12:15,879 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=498, ProcessCount=182, AvailableMemoryMB=1451 2023-07-19 00:12:15,879 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 00:12:15,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 00:12:15,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:15,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:12:15,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 00:12:15,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:12:15,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:15,888 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:15,888 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:15,889 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 empty. 2023-07-19 00:12:15,889 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa empty. 2023-07-19 00:12:15,889 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:15,889 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:15,889 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 00:12:15,904 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 00:12:15,905 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc7478a94489795c6b3612478c20f5aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:12:15,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => d6ceca1b8ac3ee1c6c804be3d63117b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp 2023-07-19 00:12:15,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:15,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing cc7478a94489795c6b3612478c20f5aa, disabling compactions & flushes 2023-07-19 00:12:15,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:15,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:15,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. after waiting 0 ms 2023-07-19 00:12:15,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:15,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:15,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for cc7478a94489795c6b3612478c20f5aa: 2023-07-19 00:12:15,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:15,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing d6ceca1b8ac3ee1c6c804be3d63117b4, disabling compactions & flushes 2023-07-19 00:12:15,931 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:15,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:15,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. after waiting 0 ms 2023-07-19 00:12:15,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:15,931 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:15,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for d6ceca1b8ac3ee1c6c804be3d63117b4: 2023-07-19 00:12:15,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:12:15,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725535935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725535935"}]},"ts":"1689725535935"} 2023-07-19 00:12:15,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725535935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725535935"}]},"ts":"1689725535935"} 2023-07-19 00:12:15,939 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:12:15,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:12:15,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725535940"}]},"ts":"1689725535940"} 2023-07-19 00:12:15,941 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 00:12:15,947 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:12:15,948 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:12:15,948 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:12:15,948 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:12:15,948 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:12:15,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, ASSIGN}] 2023-07-19 00:12:15,952 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, ASSIGN 2023-07-19 00:12:15,952 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, ASSIGN 2023-07-19 00:12:15,953 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39975,1689725421095; forceNewPlan=false, retain=false 2023-07-19 00:12:15,953 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42097,1689725420965; forceNewPlan=false, retain=false 2023-07-19 00:12:15,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:16,103 INFO [jenkins-hbase4:36871] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:12:16,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cc7478a94489795c6b3612478c20f5aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,107 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d6ceca1b8ac3ee1c6c804be3d63117b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,107 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725536107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725536107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725536107"}]},"ts":"1689725536107"} 2023-07-19 00:12:16,107 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725536107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725536107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725536107"}]},"ts":"1689725536107"} 2023-07-19 00:12:16,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure cc7478a94489795c6b3612478c20f5aa, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:12:16,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d6ceca1b8ac3ee1c6c804be3d63117b4, server=jenkins-hbase4.apache.org,42097,1689725420965}] 2023-07-19 00:12:16,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:16,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:16,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc7478a94489795c6b3612478c20f5aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:12:16,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. service=AccessControlService 2023-07-19 00:12:16,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:12:16,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:16,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,281 INFO [StoreOpener-cc7478a94489795c6b3612478c20f5aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:16,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6ceca1b8ac3ee1c6c804be3d63117b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:12:16,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. service=AccessControlService 2023-07-19 00:12:16,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:12:16,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:16,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,299 INFO [StoreOpener-d6ceca1b8ac3ee1c6c804be3d63117b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,302 DEBUG [StoreOpener-d6ceca1b8ac3ee1c6c804be3d63117b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf 2023-07-19 00:12:16,302 DEBUG [StoreOpener-d6ceca1b8ac3ee1c6c804be3d63117b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf 2023-07-19 00:12:16,302 INFO [StoreOpener-d6ceca1b8ac3ee1c6c804be3d63117b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6ceca1b8ac3ee1c6c804be3d63117b4 columnFamilyName cf 2023-07-19 00:12:16,302 DEBUG [StoreOpener-cc7478a94489795c6b3612478c20f5aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf 2023-07-19 00:12:16,303 DEBUG [StoreOpener-cc7478a94489795c6b3612478c20f5aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf 2023-07-19 00:12:16,303 INFO [StoreOpener-cc7478a94489795c6b3612478c20f5aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc7478a94489795c6b3612478c20f5aa columnFamilyName cf 2023-07-19 00:12:16,304 INFO [StoreOpener-d6ceca1b8ac3ee1c6c804be3d63117b4-1] regionserver.HStore(310): Store=d6ceca1b8ac3ee1c6c804be3d63117b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,306 INFO [StoreOpener-cc7478a94489795c6b3612478c20f5aa-1] regionserver.HStore(310): Store=cc7478a94489795c6b3612478c20f5aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:12:16,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:16,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:16,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:12:16,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:12:16,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d6ceca1b8ac3ee1c6c804be3d63117b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66091139, jitterRate=-0.015165284276008606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:12:16,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d6ceca1b8ac3ee1c6c804be3d63117b4: 2023-07-19 00:12:16,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc7478a94489795c6b3612478c20f5aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73447432, jitterRate=0.09445202350616455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:12:16,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc7478a94489795c6b3612478c20f5aa: 2023-07-19 00:12:16,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4., pid=109, masterSystemTime=1689725536262 2023-07-19 00:12:16,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa., pid=108, masterSystemTime=1689725536261 2023-07-19 00:12:16,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:16,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:16,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:16,324 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d6ceca1b8ac3ee1c6c804be3d63117b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,324 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725536324"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725536324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725536324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725536324"}]},"ts":"1689725536324"} 2023-07-19 00:12:16,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:16,327 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cc7478a94489795c6b3612478c20f5aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725536327"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725536327"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725536327"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725536327"}]},"ts":"1689725536327"} 2023-07-19 00:12:16,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 00:12:16,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d6ceca1b8ac3ee1c6c804be3d63117b4, server=jenkins-hbase4.apache.org,42097,1689725420965 in 224 msec 2023-07-19 00:12:16,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 00:12:16,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure cc7478a94489795c6b3612478c20f5aa, server=jenkins-hbase4.apache.org,39975,1689725421095 in 226 msec 2023-07-19 00:12:16,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, ASSIGN in 389 msec 2023-07-19 00:12:16,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 00:12:16,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, ASSIGN in 389 msec 2023-07-19 00:12:16,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:12:16,343 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725536343"}]},"ts":"1689725536343"} 2023-07-19 00:12:16,345 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 00:12:16,353 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:12:16,353 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 00:12:16,356 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 00:12:16,358 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:16,358 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:16,358 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:16,360 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:16,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:16,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 484 msec 2023-07-19 00:12:16,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:16,490 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 00:12:16,493 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,493 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:16,495 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:16,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:16,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725536515 (current time:1689725536515). 2023-07-19 00:12:16,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:12:16,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x1116808c to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:16,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48283bcd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:16,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:16,541 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:16,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1116808c to 127.0.0.1:57509 2023-07-19 00:12:16,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:16,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x0a540430 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:16,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fe3f716, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:16,553 DEBUG [hconnection-0x269c4774-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:16,557 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a540430 to 127.0.0.1:57509 2023-07-19 00:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 00:12:16,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:12:16,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:16,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:16,569 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:16,570 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689726136570 2023-07-19 00:12:16,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:16,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,570 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:12:16,571 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:12:16,573 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:16,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:16,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-19 00:12:16,577 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:16,577 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689726136577 2023-07-19 00:12:16,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,605 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 00:12:16,605 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:16,607 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 00:12:16,607 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 00:12:16,608 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,608 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,609 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:16,609 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:16,609 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,609 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:16,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:16,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:16,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:16,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:16,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:16,610 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,610 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,610 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,610 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:12:16,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:16,613 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:16,614 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:16,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:16,615 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:16,615 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:16,615 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:16,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:16,617 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:16,617 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:16,625 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,626 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,626 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,626 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:16,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:16,626 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:16,626 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,626 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:16,627 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,627 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,628 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b6f87a7[Count = 1] remaining members to acquire global barrier 2023-07-19 00:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:16,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:16,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:16,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b6f87a7[Count = 0] remaining members to acquire global barrier 2023-07-19 00:12:16,633 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 00:12:16,633 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:16,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:16,634 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:16,635 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:16,635 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:16,635 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:16,635 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:12:16,635 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:16,635 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. started... 2023-07-19 00:12:16,636 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc7478a94489795c6b3612478c20f5aa: 2023-07-19 00:12:16,636 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,636 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:16,636 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:12:16,635 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. started... 2023-07-19 00:12:16,641 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d6ceca1b8ac3ee1c6c804be3d63117b4: 2023-07-19 00:12:16,641 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:16,641 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:16,641 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:12:16,643 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:16,643 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:16,643 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:16,673 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:16,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:16,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:16,676 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:12:16,877 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:16,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:16,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:16,878 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:12:17,079 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. completed. 2023-07-19 00:12:17,079 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:17,079 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. completed. 2023-07-19 00:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:12:17,082 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,082 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:17,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:17,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:17,082 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:17,082 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:17,085 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,085 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:17,085 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:17,085 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:17,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:17,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42097,1689725420965': 2023-07-19 00:12:17,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 00:12:17,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:17,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:17,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:17,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:12:17,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 00:12:17,112 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 00:12:17,112 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:12:17,112 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:12:17,112 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,112 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,115 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:17,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:17,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,118 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:17,118 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,119 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,123 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,124 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:17,124 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,138 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,138 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,138 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,138 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:17,139 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,140 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:17,140 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,140 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:17,140 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,140 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,140 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:17,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,140 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:17,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:12:17,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:17,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:17,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 00:12:17,179 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:17,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:17,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:17,181 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:12:17,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 00:12:17,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,403 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689725536570Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689725537238 (+668 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725537238Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725537238Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725537262 (+24 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725537305 (+43 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689725537402 (+97 ms) 2023-07-19 00:12:17,406 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:17,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 836 msec 2023-07-19 00:12:17,434 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 00:12:17,681 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:17,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:17,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:12:17,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39975] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:12:17,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42097] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:12:17,703 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,703 DEBUG [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:17,703 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:17,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:17,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725537722 (current time:1689725537722). 2023-07-19 00:12:17,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:12:17,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x1e016304 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:17,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a622057, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:17,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:17,785 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:17,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e016304 to 127.0.0.1:57509 2023-07-19 00:12:17,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:17,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(139): Connect 0x0f61020c to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a6d49a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:17,861 DEBUG [hconnection-0x51c6a225-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:17,862 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:17,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f61020c to 127.0.0.1:57509 2023-07-19 00:12:17,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:17,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 00:12:17,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:12:17,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:17,889 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:17,892 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689726137892 2023-07-19 00:12:17,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:17,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,895 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:12:17,895 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:12:17,896 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:17,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:17,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-19 00:12:17,899 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:17,900 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689726137900 2023-07-19 00:12:17,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,967 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 00:12:17,967 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:17,969 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 00:12:17,969 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 00:12:17,995 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,995 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,996 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:17,997 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:17,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:17,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:17,997 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:17,997 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:17,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:17,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:17,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:17,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:17,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,998 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:17,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,998 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:12:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 00:12:17,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:17,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:17,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,000 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,000 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 00:12:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 00:12:18,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:18,001 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,001 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:12:18,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,004 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:18,004 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:18,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1689725421035' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:18,021 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,007 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:18,022 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:18,025 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,025 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:18,028 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,028 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,028 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:18,033 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,033 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,033 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:18,034 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:18,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:18,036 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:18,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39975,1689725421095' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:18,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1aeb1ca[Count = 1] remaining members to acquire global barrier 2023-07-19 00:12:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:18,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42097,1689725420965' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:18,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1aeb1ca[Count = 0] remaining members to acquire global barrier 2023-07-19 00:12:18,042 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 00:12:18,043 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,048 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,048 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:18,049 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,049 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:18,049 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43375,1689725421035' in zk 2023-07-19 00:12:18,053 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,053 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:12:18,053 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,053 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,053 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:18,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,054 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:18,055 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:18,055 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:18,055 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1689725421035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:18,057 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:18,070 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:18,071 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:18,069 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:18,069 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:18,071 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. started... 2023-07-19 00:12:18,071 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. started... 2023-07-19 00:12:18,071 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:18,071 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc7478a94489795c6b3612478c20f5aa 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 00:12:18,071 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d6ceca1b8ac3ee1c6c804be3d63117b4 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 00:12:18,141 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307191d1f24a52b8a45598ab2b5641a7a5eb1 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191d1f24a52b8a45598ab2b5641a7a5eb1 2023-07-19 00:12:18,180 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307199da78f337b9743b7907954dce66bb6b0 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199da78f337b9743b7907954dce66bb6b0 2023-07-19 00:12:18,199 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:18,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:18,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:18,203 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:12:18,259 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/.tmp/cf/71ad2a5f1869478c880ae683a2f051aa 2023-07-19 00:12:18,267 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/.tmp/cf/71ad2a5f1869478c880ae683a2f051aa as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf/71ad2a5f1869478c880ae683a2f051aa 2023-07-19 00:12:18,274 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf/71ad2a5f1869478c880ae683a2f051aa, entries=45, sequenceid=6, filesize=13.0 K 2023-07-19 00:12:18,275 INFO [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for d6ceca1b8ac3ee1c6c804be3d63117b4 in 204ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:18,298 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d6ceca1b8ac3ee1c6c804be3d63117b4: 2023-07-19 00:12:18,298 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,298 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:18,299 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf/71ad2a5f1869478c880ae683a2f051aa] hfiles 2023-07-19 00:12:18,299 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf/71ad2a5f1869478c880ae683a2f051aa for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,319 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/.tmp/cf/3a59c8c756af48a39edc659cfdfa8ff7 2023-07-19 00:12:18,336 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/.tmp/cf/3a59c8c756af48a39edc659cfdfa8ff7 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf/3a59c8c756af48a39edc659cfdfa8ff7 2023-07-19 00:12:18,343 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf/3a59c8c756af48a39edc659cfdfa8ff7, entries=5, sequenceid=6, filesize=5.8 K 2023-07-19 00:12:18,344 INFO [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for cc7478a94489795c6b3612478c20f5aa in 273ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:18,344 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc7478a94489795c6b3612478c20f5aa: 2023-07-19 00:12:18,344 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,344 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:18,344 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf/3a59c8c756af48a39edc659cfdfa8ff7] hfiles 2023-07-19 00:12:18,344 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf/3a59c8c756af48a39edc659cfdfa8ff7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,356 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. completed. 2023-07-19 00:12:18,356 DEBUG [rs(jenkins-hbase4.apache.org,42097,1689725420965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:18,356 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:18,356 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:18,357 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,363 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:18,363 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42097,1689725420965' in zk 2023-07-19 00:12:18,372 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:18,372 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,372 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:18,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:18,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:18,372 DEBUG [member: 'jenkins-hbase4.apache.org,42097,1689725420965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:18,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:18,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:18,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:18,376 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. completed. 2023-07-19 00:12:18,376 DEBUG [rs(jenkins-hbase4.apache.org,39975,1689725421095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39975,1689725421095' in zk 2023-07-19 00:12:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,380 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:18,380 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,380 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:18,380 DEBUG [member: 'jenkins-hbase4.apache.org,39975,1689725421095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42097,1689725420965': 2023-07-19 00:12:18,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42097,1689725420965' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 00:12:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:18,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39975,1689725421095': 2023-07-19 00:12:18,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39975,1689725421095' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 00:12:18,394 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 00:12:18,394 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:12:18,394 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:12:18,394 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,394 INFO [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:18,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:18,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:18,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:18,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:18,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,401 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,404 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,404 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:18,412 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,413 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,413 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,417 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:18,417 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:18,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:18,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:18,417 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:18,417 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:18,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:18,419 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:18,419 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:18,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:18,419 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,419 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,419 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:18,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:18,419 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,420 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,421 DEBUG [(jenkins-hbase4.apache.org,36871,1689725419478)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:18,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 00:12:18,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191d1f24a52b8a45598ab2b5641a7a5eb1, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199da78f337b9743b7907954dce66bb6b0] mob files 2023-07-19 00:12:18,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191d1f24a52b8a45598ab2b5641a7a5eb1 2023-07-19 00:12:18,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199da78f337b9743b7907954dce66bb6b0 2023-07-19 00:12:18,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,503 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:18,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:18,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:18,505 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:12:18,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 00:12:18,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,580 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:18,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689725537893Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689725538454 (+561 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689725538454Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689725538454Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689725538465 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689725538507 (+42 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689725538579 (+72 ms) 2023-07-19 00:12:18,583 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:18,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 688 msec 2023-07-19 00:12:19,005 DEBUG [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:19,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:19,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:12:19,007 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007 2023-07-19 00:12:19,007 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40831, tgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007, rawTgtDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007, srcFsUri=hdfs://localhost:40831, srcDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:12:19,033 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e 2023-07-19 00:12:19,033 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_813765300_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:19,034 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40831, inputRoot=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e, snapshotDir=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 00:12:19,067 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:19,226 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,227 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,228 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,228 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,229 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,229 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,404 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/hadoop-7589519082413856819.jar 2023-07-19 00:12:19,404 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,405 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,405 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,406 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,406 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,407 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:19,407 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:12:19,408 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:12:19,409 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:12:19,409 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:12:19,410 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:12:19,410 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:12:19,412 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:12:19,412 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:12:19,413 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:19,415 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:19,415 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:19,416 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:19,416 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:19,417 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:19,417 DEBUG [Listener at jenkins-hbase4.apache.org/43275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:20,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0006_000001 (auth:SIMPLE) 2023-07-19 00:12:20,952 WARN [Listener at jenkins-hbase4.apache.org/43275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:12:20,956 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 00:12:20,958 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-19 00:12:21,048 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:21,048 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:21,210 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:21,244 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:12:26,800 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:29,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:32,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:34,200 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:12:34,200 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:12:34,219 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,219 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:12:34,220 INFO [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:12:34,220 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,220 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 00:12:34,220 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 00:12:34,221 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1397518838_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,221 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 00:12:34,221 DEBUG [Listener at jenkins-hbase4.apache.org/43275] snapshot.TestExportSnapshot(367): hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/export-test/export-1689725539007/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 00:12:34,229 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 00:12:34,242 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725554242"}]},"ts":"1689725554242"} 2023-07-19 00:12:34,244 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 00:12:34,246 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 00:12:34,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, UNASSIGN}] 2023-07-19 00:12:34,250 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, UNASSIGN 2023-07-19 00:12:34,250 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, UNASSIGN 2023-07-19 00:12:34,250 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cc7478a94489795c6b3612478c20f5aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:12:34,250 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d6ceca1b8ac3ee1c6c804be3d63117b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:12:34,251 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725554250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725554250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725554250"}]},"ts":"1689725554250"} 2023-07-19 00:12:34,251 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725554250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725554250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725554250"}]},"ts":"1689725554250"} 2023-07-19 00:12:34,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure d6ceca1b8ac3ee1c6c804be3d63117b4, server=jenkins-hbase4.apache.org,42097,1689725420965}] 2023-07-19 00:12:34,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure cc7478a94489795c6b3612478c20f5aa, server=jenkins-hbase4.apache.org,39975,1689725421095}] 2023-07-19 00:12:34,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 00:12:34,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:34,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d6ceca1b8ac3ee1c6c804be3d63117b4, disabling compactions & flushes 2023-07-19 00:12:34,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:34,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:34,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. after waiting 0 ms 2023-07-19 00:12:34,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:34,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:34,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc7478a94489795c6b3612478c20f5aa, disabling compactions & flushes 2023-07-19 00:12:34,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:34,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:34,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. after waiting 0 ms 2023-07-19 00:12:34,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:34,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:34,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:34,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4. 2023-07-19 00:12:34,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d6ceca1b8ac3ee1c6c804be3d63117b4: 2023-07-19 00:12:34,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:34,436 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d6ceca1b8ac3ee1c6c804be3d63117b4, regionState=CLOSED 2023-07-19 00:12:34,436 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725554436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725554436"}]},"ts":"1689725554436"} 2023-07-19 00:12:34,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-19 00:12:34,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure d6ceca1b8ac3ee1c6c804be3d63117b4, server=jenkins-hbase4.apache.org,42097,1689725420965 in 186 msec 2023-07-19 00:12:34,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6ceca1b8ac3ee1c6c804be3d63117b4, UNASSIGN in 197 msec 2023-07-19 00:12:34,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:34,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:34,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa. 2023-07-19 00:12:34,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc7478a94489795c6b3612478c20f5aa: 2023-07-19 00:12:34,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:34,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cc7478a94489795c6b3612478c20f5aa, regionState=CLOSED 2023-07-19 00:12:34,460 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725554459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725554459"}]},"ts":"1689725554459"} 2023-07-19 00:12:34,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-19 00:12:34,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure cc7478a94489795c6b3612478c20f5aa, server=jenkins-hbase4.apache.org,39975,1689725421095 in 208 msec 2023-07-19 00:12:34,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 00:12:34,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc7478a94489795c6b3612478c20f5aa, UNASSIGN in 216 msec 2023-07-19 00:12:34,466 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725554466"}]},"ts":"1689725554466"} 2023-07-19 00:12:34,467 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 00:12:34,469 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 00:12:34,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 241 msec 2023-07-19 00:12:34,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 00:12:34,542 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 00:12:34,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,548 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,549 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,554 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39975] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,559 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:34,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:34,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:34,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:34,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:34,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:34,562 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:34,563 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,563 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:34,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 00:12:34,567 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:34,575 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:34,577 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/recovered.edits] 2023-07-19 00:12:34,581 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf/71ad2a5f1869478c880ae683a2f051aa to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/cf/71ad2a5f1869478c880ae683a2f051aa 2023-07-19 00:12:34,585 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf, FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/recovered.edits] 2023-07-19 00:12:34,588 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4/recovered.edits/9.seqid 2023-07-19 00:12:34,588 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6ceca1b8ac3ee1c6c804be3d63117b4 2023-07-19 00:12:34,592 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf/3a59c8c756af48a39edc659cfdfa8ff7 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/cf/3a59c8c756af48a39edc659cfdfa8ff7 2023-07-19 00:12:34,598 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/recovered.edits/9.seqid to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa/recovered.edits/9.seqid 2023-07-19 00:12:34,599 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc7478a94489795c6b3612478c20f5aa 2023-07-19 00:12:34,599 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 00:12:34,599 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 00:12:34,601 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-19 00:12:34,608 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191d1f24a52b8a45598ab2b5641a7a5eb1 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191d1f24a52b8a45598ab2b5641a7a5eb1 2023-07-19 00:12:34,609 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199da78f337b9743b7907954dce66bb6b0 to hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199da78f337b9743b7907954dce66bb6b0 2023-07-19 00:12:34,610 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 00:12:34,612 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,618 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 00:12:34,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 00:12:34,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,635 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 00:12:34,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725554635"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:34,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725554635"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:34,641 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:12:34,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cc7478a94489795c6b3612478c20f5aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689725535880.cc7478a94489795c6b3612478c20f5aa.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d6ceca1b8ac3ee1c6c804be3d63117b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725535880.d6ceca1b8ac3ee1c6c804be3d63117b4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:12:34,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 00:12:34,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725554642"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:34,645 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 00:12:34,647 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 104 msec 2023-07-19 00:12:34,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 00:12:34,665 INFO [Listener at jenkins-hbase4.apache.org/43275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 00:12:34,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 00:12:34,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 00:12:34,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:34,714 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 760) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-232193376_1 at /127.0.0.1:54378 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:54382 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-232193376_1 at /127.0.0.1:58128 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:51860 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5662 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1397518838_17 at /127.0.0.1:58154 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:42019 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x35fb0b5b-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=484 (was 498), ProcessCount=182 (was 182), AvailableMemoryMB=1848 (was 1451) - AvailableMemoryMB LEAK? - 2023-07-19 00:12:34,715 WARN [Listener at jenkins-hbase4.apache.org/43275] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 00:12:34,715 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 00:12:34,730 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:12:39,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428933_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:40,017 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:12:48,853 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:13:03,005 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 00:13:03,006 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:13:03,119 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 00:13:03,134 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 00:13:03,136 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 00:13:03,166 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:13:03,270 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 00:13:03,270 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 00:13:03,270 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 00:13:03,271 INFO [Listener at jenkins-hbase4.apache.org/43275] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 00:13:03,271 DEBUG [Listener at jenkins-hbase4.apache.org/43275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x572c911d to 127.0.0.1:57509 2023-07-19 00:13:03,271 DEBUG [Listener at jenkins-hbase4.apache.org/43275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,271 DEBUG [Listener at jenkins-hbase4.apache.org/43275] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 00:13:03,271 DEBUG [Listener at jenkins-hbase4.apache.org/43275] util.JVMClusterUtil(257): Found active master hash=727074255, stopped=false 2023-07-19 00:13:03,271 DEBUG [Listener at jenkins-hbase4.apache.org/43275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,273 DEBUG [Listener at jenkins-hbase4.apache.org/43275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 00:13:03,273 INFO [Listener at jenkins-hbase4.apache.org/43275] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:13:03,275 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:13:03,275 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:13:03,275 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:13:03,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:13:03,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:13:03,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:13:03,276 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:13:03,276 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:13:03,276 INFO [Listener at jenkins-hbase4.apache.org/43275] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 00:13:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/43275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x601f56c0 to 127.0.0.1:57509 2023-07-19 00:13:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/43275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,277 INFO [Listener at jenkins-hbase4.apache.org/43275] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42097,1689725420965' ***** 2023-07-19 00:13:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/43275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,277 INFO [Listener at jenkins-hbase4.apache.org/43275] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 00:13:03,277 INFO [Listener at jenkins-hbase4.apache.org/43275] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43375,1689725421035' ***** 2023-07-19 00:13:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/43275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,277 INFO [Listener at jenkins-hbase4.apache.org/43275] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 00:13:03,277 INFO [Listener at jenkins-hbase4.apache.org/43275] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39975,1689725421095' ***** 2023-07-19 00:13:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/43275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,277 INFO [Listener at jenkins-hbase4.apache.org/43275] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 00:13:03,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:13:03,278 INFO [RS:2;jenkins-hbase4:39975] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 00:13:03,278 INFO [RS:0;jenkins-hbase4:42097] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 00:13:03,278 INFO [RS:2;jenkins-hbase4:39975] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 00:13:03,277 INFO [RS:1;jenkins-hbase4:43375] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 00:13:03,278 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 00:13:03,278 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 00:13:03,278 INFO [RS:1;jenkins-hbase4:43375] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 00:13:03,278 INFO [RS:2;jenkins-hbase4:39975] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 00:13:03,278 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 00:13:03,278 INFO [RS:0;jenkins-hbase4:42097] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 00:13:03,279 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(3305): Received CLOSE for ec30c79cfc94ed61f17c077f3efb3d77 2023-07-19 00:13:03,278 INFO [RS:1;jenkins-hbase4:43375] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 00:13:03,279 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:13:03,279 DEBUG [RS:1;jenkins-hbase4:43375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0be92c0e to 127.0.0.1:57509 2023-07-19 00:13:03,279 DEBUG [RS:1;jenkins-hbase4:43375] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,279 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(3305): Received CLOSE for feaa797b22f0c98625948f3592412afe 2023-07-19 00:13:03,279 INFO [RS:0;jenkins-hbase4:42097] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 00:13:03,281 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:13:03,281 DEBUG [RS:0;jenkins-hbase4:42097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x087f00fd to 127.0.0.1:57509 2023-07-19 00:13:03,281 DEBUG [RS:0;jenkins-hbase4:42097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,281 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43375,1689725421035; all regions closed. 2023-07-19 00:13:03,279 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:13:03,284 DEBUG [RS:2;jenkins-hbase4:39975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4364437b to 127.0.0.1:57509 2023-07-19 00:13:03,284 DEBUG [RS:2;jenkins-hbase4:39975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,287 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:13:03,288 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42097,1689725420965; all regions closed. 2023-07-19 00:13:03,294 INFO [RS:2;jenkins-hbase4:39975] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 00:13:03,294 INFO [RS:2;jenkins-hbase4:39975] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 00:13:03,294 INFO [RS:2;jenkins-hbase4:39975] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 00:13:03,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec30c79cfc94ed61f17c077f3efb3d77, disabling compactions & flushes 2023-07-19 00:13:03,295 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 00:13:03,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:13:03,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:13:03,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. after waiting 0 ms 2023-07-19 00:13:03,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:13:03,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec30c79cfc94ed61f17c077f3efb3d77 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 00:13:03,303 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-19 00:13:03,304 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1478): Online Regions={ec30c79cfc94ed61f17c077f3efb3d77=hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77., 1588230740=hbase:meta,,1.1588230740, feaa797b22f0c98625948f3592412afe=hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe.} 2023-07-19 00:13:03,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 00:13:03,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 00:13:03,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 00:13:03,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 00:13:03,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 00:13:03,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 00:13:03,305 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1504): Waiting on 1588230740, ec30c79cfc94ed61f17c077f3efb3d77, feaa797b22f0c98625948f3592412afe 2023-07-19 00:13:03,317 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:13:03,327 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:13:03,410 DEBUG [RS:0;jenkins-hbase4:42097] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs 2023-07-19 00:13:03,410 INFO [RS:0;jenkins-hbase4:42097] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42097%2C1689725420965:(num 1689725423338) 2023-07-19 00:13:03,410 DEBUG [RS:0;jenkins-hbase4:42097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,410 INFO [RS:0;jenkins-hbase4:42097] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:13:03,412 INFO [RS:0;jenkins-hbase4:42097] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 00:13:03,412 INFO [RS:0;jenkins-hbase4:42097] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 00:13:03,412 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:13:03,412 INFO [RS:0;jenkins-hbase4:42097] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 00:13:03,413 INFO [RS:0;jenkins-hbase4:42097] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 00:13:03,415 INFO [RS:0;jenkins-hbase4:42097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42097 2023-07-19 00:13:03,420 DEBUG [RS:1;jenkins-hbase4:43375] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs 2023-07-19 00:13:03,420 INFO [RS:1;jenkins-hbase4:43375] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43375%2C1689725421035:(num 1689725423340) 2023-07-19 00:13:03,420 DEBUG [RS:1;jenkins-hbase4:43375] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,420 INFO [RS:1;jenkins-hbase4:43375] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:13:03,420 INFO [RS:1;jenkins-hbase4:43375] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 00:13:03,425 INFO [RS:1;jenkins-hbase4:43375] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 00:13:03,425 INFO [RS:1;jenkins-hbase4:43375] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 00:13:03,425 INFO [RS:1;jenkins-hbase4:43375] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 00:13:03,425 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:13:03,426 INFO [RS:1;jenkins-hbase4:43375] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43375 2023-07-19 00:13:03,429 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:13:03,429 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:13:03,430 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:13:03,430 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:13:03,430 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:13:03,430 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42097,1689725420965 2023-07-19 00:13:03,430 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:13:03,430 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42097,1689725420965] 2023-07-19 00:13:03,431 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:13:03,431 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:13:03,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/.tmp/info/6797ca9f7a8645c880b605a02db5d753 2023-07-19 00:13:03,438 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43375,1689725421035 2023-07-19 00:13:03,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/.tmp/info/8a71b54fd4c7471eade69cbfd230ec81 2023-07-19 00:13:03,442 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42097,1689725420965; numProcessing=1 2023-07-19 00:13:03,506 DEBUG [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1504): Waiting on 1588230740, ec30c79cfc94ed61f17c077f3efb3d77, feaa797b22f0c98625948f3592412afe 2023-07-19 00:13:03,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6797ca9f7a8645c880b605a02db5d753 2023-07-19 00:13:03,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/.tmp/info/8a71b54fd4c7471eade69cbfd230ec81 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/info/8a71b54fd4c7471eade69cbfd230ec81 2023-07-19 00:13:03,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/info/8a71b54fd4c7471eade69cbfd230ec81, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 00:13:03,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ec30c79cfc94ed61f17c077f3efb3d77 in 234ms, sequenceid=6, compaction requested=false 2023-07-19 00:13:03,534 INFO [RS:0;jenkins-hbase4:42097] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42097,1689725420965; zookeeper connection closed. 2023-07-19 00:13:03,534 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,534 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:42097-0x1017aea3ef60001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,534 INFO [RS:1;jenkins-hbase4:43375] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43375,1689725421035; zookeeper connection closed. 2023-07-19 00:13:03,534 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,534 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x1017aea3ef60002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,535 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42097,1689725420965 already deleted, retry=false 2023-07-19 00:13:03,535 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42097,1689725420965 expired; onlineServers=2 2023-07-19 00:13:03,535 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43375,1689725421035] 2023-07-19 00:13:03,536 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43375,1689725421035; numProcessing=2 2023-07-19 00:13:03,536 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43375,1689725421035 already deleted, retry=false 2023-07-19 00:13:03,537 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43375,1689725421035 expired; onlineServers=1 2023-07-19 00:13:03,539 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71c43041] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71c43041 2023-07-19 00:13:03,541 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5abcdafe] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5abcdafe 2023-07-19 00:13:03,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/namespace/ec30c79cfc94ed61f17c077f3efb3d77/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:13:03,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:13:03,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec30c79cfc94ed61f17c077f3efb3d77: 2023-07-19 00:13:03,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689725423962.ec30c79cfc94ed61f17c077f3efb3d77. 2023-07-19 00:13:03,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing feaa797b22f0c98625948f3592412afe, disabling compactions & flushes 2023-07-19 00:13:03,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:13:03,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:13:03,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. after waiting 0 ms 2023-07-19 00:13:03,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:13:03,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing feaa797b22f0c98625948f3592412afe 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 00:13:03,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/.tmp/rep_barrier/b38a9a23b9a8404795a2da76ef58b35d 2023-07-19 00:13:03,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b38a9a23b9a8404795a2da76ef58b35d 2023-07-19 00:13:03,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/.tmp/l/dfc498ef954d429d876b9017b242a0e1 2023-07-19 00:13:03,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfc498ef954d429d876b9017b242a0e1 2023-07-19 00:13:03,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/.tmp/l/dfc498ef954d429d876b9017b242a0e1 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/l/dfc498ef954d429d876b9017b242a0e1 2023-07-19 00:13:03,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/.tmp/table/d4577ae9989246c5b6a46c71ec6fb7e8 2023-07-19 00:13:03,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfc498ef954d429d876b9017b242a0e1 2023-07-19 00:13:03,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/l/dfc498ef954d429d876b9017b242a0e1, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 00:13:03,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for feaa797b22f0c98625948f3592412afe in 56ms, sequenceid=18, compaction requested=false 2023-07-19 00:13:03,608 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4577ae9989246c5b6a46c71ec6fb7e8 2023-07-19 00:13:03,609 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/.tmp/info/6797ca9f7a8645c880b605a02db5d753 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/info/6797ca9f7a8645c880b605a02db5d753 2023-07-19 00:13:03,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6797ca9f7a8645c880b605a02db5d753 2023-07-19 00:13:03,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/info/6797ca9f7a8645c880b605a02db5d753, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 00:13:03,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/acl/feaa797b22f0c98625948f3592412afe/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 00:13:03,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:13:03,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for feaa797b22f0c98625948f3592412afe: 2023-07-19 00:13:03,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/.tmp/rep_barrier/b38a9a23b9a8404795a2da76ef58b35d as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/rep_barrier/b38a9a23b9a8404795a2da76ef58b35d 2023-07-19 00:13:03,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689725424879.feaa797b22f0c98625948f3592412afe. 2023-07-19 00:13:03,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b38a9a23b9a8404795a2da76ef58b35d 2023-07-19 00:13:03,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/rep_barrier/b38a9a23b9a8404795a2da76ef58b35d, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 00:13:03,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/.tmp/table/d4577ae9989246c5b6a46c71ec6fb7e8 as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/table/d4577ae9989246c5b6a46c71ec6fb7e8 2023-07-19 00:13:03,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4577ae9989246c5b6a46c71ec6fb7e8 2023-07-19 00:13:03,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/table/d4577ae9989246c5b6a46c71ec6fb7e8, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 00:13:03,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 326ms, sequenceid=131, compaction requested=false 2023-07-19 00:13:03,663 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 00:13:03,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:13:03,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 00:13:03,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 00:13:03,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 00:13:03,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 00:13:03,706 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39975,1689725421095; all regions closed. 2023-07-19 00:13:03,719 DEBUG [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs 2023-07-19 00:13:03,719 INFO [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39975%2C1689725421095.meta:.meta(num 1689725423544) 2023-07-19 00:13:03,744 DEBUG [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/oldWALs 2023-07-19 00:13:03,744 INFO [RS:2;jenkins-hbase4:39975] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39975%2C1689725421095:(num 1689725423340) 2023-07-19 00:13:03,744 DEBUG [RS:2;jenkins-hbase4:39975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,744 INFO [RS:2;jenkins-hbase4:39975] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:13:03,745 INFO [RS:2;jenkins-hbase4:39975] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 00:13:03,745 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:13:03,746 INFO [RS:2;jenkins-hbase4:39975] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39975 2023-07-19 00:13:03,754 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:13:03,754 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39975,1689725421095 2023-07-19 00:13:03,754 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39975,1689725421095] 2023-07-19 00:13:03,754 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39975,1689725421095; numProcessing=3 2023-07-19 00:13:03,758 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39975,1689725421095 already deleted, retry=false 2023-07-19 00:13:03,758 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39975,1689725421095 expired; onlineServers=0 2023-07-19 00:13:03,758 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36871,1689725419478' ***** 2023-07-19 00:13:03,758 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 00:13:03,758 DEBUG [M:0;jenkins-hbase4:36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6b4ff4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:13:03,759 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36871,1689725419478 2023-07-19 00:13:03,759 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36871,1689725419478; all regions closed. 2023-07-19 00:13:03,759 DEBUG [M:0;jenkins-hbase4:36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:13:03,759 DEBUG [M:0;jenkins-hbase4:36871] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 00:13:03,759 DEBUG [M:0;jenkins-hbase4:36871] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 00:13:03,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689725422803] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689725422803,5,FailOnTimeoutGroup] 2023-07-19 00:13:03,759 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 00:13:03,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689725422802] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689725422802,5,FailOnTimeoutGroup] 2023-07-19 00:13:03,760 INFO [M:0;jenkins-hbase4:36871] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 00:13:03,760 INFO [M:0;jenkins-hbase4:36871] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 00:13:03,760 INFO [M:0;jenkins-hbase4:36871] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 00:13:03,760 DEBUG [M:0;jenkins-hbase4:36871] master.HMaster(1512): Stopping service threads 2023-07-19 00:13:03,760 INFO [M:0;jenkins-hbase4:36871] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 00:13:03,760 ERROR [M:0;jenkins-hbase4:36871] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 00:13:03,761 INFO [M:0;jenkins-hbase4:36871] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 00:13:03,761 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 00:13:03,762 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 00:13:03,763 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:13:03,763 DEBUG [M:0;jenkins-hbase4:36871] zookeeper.ZKUtil(398): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 00:13:03,763 WARN [M:0;jenkins-hbase4:36871] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 00:13:03,763 INFO [M:0;jenkins-hbase4:36871] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 00:13:03,763 INFO [M:0;jenkins-hbase4:36871] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 00:13:03,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:13:03,765 DEBUG [M:0;jenkins-hbase4:36871] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 00:13:03,765 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:13:03,765 DEBUG [M:0;jenkins-hbase4:36871] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:13:03,765 DEBUG [M:0;jenkins-hbase4:36871] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 00:13:03,765 DEBUG [M:0;jenkins-hbase4:36871] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:13:03,765 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.16 KB 2023-07-19 00:13:03,838 INFO [M:0;jenkins-hbase4:36871] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1f5bc0eefd954506902105fff7507b0e 2023-07-19 00:13:03,850 INFO [M:0;jenkins-hbase4:36871] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f5bc0eefd954506902105fff7507b0e 2023-07-19 00:13:03,851 DEBUG [M:0;jenkins-hbase4:36871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1f5bc0eefd954506902105fff7507b0e as hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1f5bc0eefd954506902105fff7507b0e 2023-07-19 00:13:03,857 INFO [M:0;jenkins-hbase4:36871] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f5bc0eefd954506902105fff7507b0e 2023-07-19 00:13:03,858 INFO [M:0;jenkins-hbase4:36871] regionserver.HStore(1080): Added hdfs://localhost:40831/user/jenkins/test-data/d8dc7a0d-3a96-2701-8987-042167b9f98e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1f5bc0eefd954506902105fff7507b0e, entries=119, sequenceid=899, filesize=28.7 K 2023-07-19 00:13:03,858 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,858 INFO [RS:2;jenkins-hbase4:39975] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39975,1689725421095; zookeeper connection closed. 2023-07-19 00:13:03,858 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): regionserver:39975-0x1017aea3ef60003, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,859 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6093cfea] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6093cfea 2023-07-19 00:13:03,859 INFO [Listener at jenkins-hbase4.apache.org/43275] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 00:13:03,859 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384924, heapSize ~452.15 KB/463000, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 94ms, sequenceid=899, compaction requested=false 2023-07-19 00:13:03,866 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:13:03,867 DEBUG [M:0;jenkins-hbase4:36871] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 00:13:03,882 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:13:03,882 INFO [M:0;jenkins-hbase4:36871] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 00:13:03,883 INFO [M:0;jenkins-hbase4:36871] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36871 2023-07-19 00:13:03,885 DEBUG [M:0;jenkins-hbase4:36871] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36871,1689725419478 already deleted, retry=false 2023-07-19 00:13:03,987 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,987 DEBUG [Listener at localhost/33023-EventThread] zookeeper.ZKWatcher(600): master:36871-0x1017aea3ef60000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:13:03,987 INFO [M:0;jenkins-hbase4:36871] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36871,1689725419478; zookeeper connection closed. 2023-07-19 00:13:03,989 WARN [Listener at jenkins-hbase4.apache.org/43275] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 00:13:04,021 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:13:04,126 WARN [BP-1815651958-172.31.14.131-1689725415331 heartbeating to localhost/127.0.0.1:40831] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 00:13:04,150 WARN [BP-1815651958-172.31.14.131-1689725415331 heartbeating to localhost/127.0.0.1:40831] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1815651958-172.31.14.131-1689725415331 (Datanode Uuid 03dc9f9e-dd16-408c-93f2-1d5f364d54f8) service to localhost/127.0.0.1:40831 2023-07-19 00:13:04,199 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data5/current/BP-1815651958-172.31.14.131-1689725415331] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:13:04,199 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data6/current/BP-1815651958-172.31.14.131-1689725415331] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:13:04,203 WARN [Listener at jenkins-hbase4.apache.org/43275] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 00:13:04,248 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:13:04,352 WARN [BP-1815651958-172.31.14.131-1689725415331 heartbeating to localhost/127.0.0.1:40831] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 00:13:04,352 WARN [BP-1815651958-172.31.14.131-1689725415331 heartbeating to localhost/127.0.0.1:40831] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1815651958-172.31.14.131-1689725415331 (Datanode Uuid 47e38a39-36c5-4434-88ca-63fcc95ffe84) service to localhost/127.0.0.1:40831 2023-07-19 00:13:04,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data3/current/BP-1815651958-172.31.14.131-1689725415331] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:13:04,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data4/current/BP-1815651958-172.31.14.131-1689725415331] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:13:04,388 WARN [Listener at jenkins-hbase4.apache.org/43275] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 00:13:04,407 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:13:04,512 WARN [BP-1815651958-172.31.14.131-1689725415331 heartbeating to localhost/127.0.0.1:40831] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 00:13:04,512 WARN [BP-1815651958-172.31.14.131-1689725415331 heartbeating to localhost/127.0.0.1:40831] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1815651958-172.31.14.131-1689725415331 (Datanode Uuid cbb57f4d-45de-42c1-8160-79bc727d05f4) service to localhost/127.0.0.1:40831 2023-07-19 00:13:04,513 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data1/current/BP-1815651958-172.31.14.131-1689725415331] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:13:04,513 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ae813cd-7228-1df0-b3ce-8a9b948abc3e/cluster_c7959d56-e259-daa9-8efb-d0875b463986/dfs/data/data2/current/BP-1815651958-172.31.14.131-1689725415331] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:13:04,537 INFO [Listener at jenkins-hbase4.apache.org/43275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:13:04,664 INFO [Listener at jenkins-hbase4.apache.org/43275] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 00:13:04,760 INFO [Listener at jenkins-hbase4.apache.org/43275] hbase.HBaseTestingUtility(1293): Minicluster is down